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ABSTRACT 


This  research  paper  proposes  a  framework  for  capturing  and 
studying  Technical  Management  Oversight  (TMO)  knowledge  from  past 
and  ongoing  international  programs.  Interviews  were  conducted  with  key 
program  personnel  from  several  programs  to  populate  the  framework 
with  program  data.  Programs  considered  were  HAWK,  ROLAND,  LANCE, 
MEADS,  the  International  Space  Station,  and  MLRS  TOW.  These 
programs  had  various  degrees  of  international  participation  and  various 
degrees  of  international  coupling.  Valuable  insights  were  captured  that 
can  be  applied  to  the  structure  and  conduct  of  ongoing  and  future 
international  programs.  Among  other  conclusions,  it  is  found  that  U.S. 
policy  has  not  kept  pace  with  international  programs,  the  degree  of 
international  coupling  within  a  program  strongly  affects  management 
complexity  and  it  is  important  to  know  the  customers.  Restrictions  on 
technology  transfer  and  release  of  information  dramatically  affect  TMO. 
Cost  share  and  work  share  issues  strongly  impact  TMO,  and  patience 
and  diplomacy  are  vital. 
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I.  INTRODUCTION 


A.  PURPOSE 

This  research  paper  advances  understanding  of  technical 
management  for  complex,  internationally  acquired  systems.  A  Technical 
Management  Oversight  (TMO)  framework  is  used  to  present  and  analyze 
six  significant  international  systems  developed  involving  the  United 
States  Army  and  NASA. 

B.  BACKGROUND 

The  industrial  revolution,  fueled  by  commercial  opportunity, 
spawned  previously  undreamed  systems.  These  systems  were  made 
possible  by  application  of  the  scientific  method  and  the  discovery  of  new 
materials  and  phenomenon.  The  discovery  and  investigation  of  electricity 
and  the  development  of  transistors,  integrated  circuits,  computers  and 
networks,  continues  to  reshape  our  world. 

New  systems  are  being  developed  that  are  increasingly  complex 
with  competing  requirements,  containing  multiple  subsystems  with 
millions  of  components,  having  computers  with  millions  of  lines  of 
computer  source  code.  The  discipline  of  system  engineering  has  emerged 
to  address  this  complexity. 

DoD  engages  in  the  development  of  complex  systems.  Many 
organizations  are  involved,  playing  different  roles.  Various  approaches  to 
contracting  and  distribution  of  development  responsibility  are  used, 
involving  varying  degrees  of  contractor  -  contractor  and  Government  - 
contractor  teaming.  The  Program  Management  Office  (PMO)  is  the  DoD 
focus  of  control  for  execution  of  contracts,  contractor  oversight,  and 
coordination  with  other  government  agencies.  The  prime  contractor  has 
the  responsibility  for  fulfilling  the  contract.  The  Government  program 
office  must  establish  an  appropriate  technical  management  approach  to 

satisfy  regulatory  and  statutory  requirements,  to  hold  the  contractor 
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accountable,  and  to  overcome  teehnieal  risk  that  eannot  be  direetly 
addressed  by  the  eontraetor.  For  international  programs,  due  to  seeurity 
and  teehnieal  transfer  eonsiderations,  some  TMO  funetions  may  be  split 
between  an  International  Program  Offiee  (IPO)  and  National  Produet 
Offiees  (NPOs)  .  This  interfaee  adds  eomplexity  and  inereases  the 
importanee  of  establishing  “agreed  to”  TMO  objeetives. 

C.  RESEARCH  QUESTIONS 

1.  PRIMARY  RESEARCH  QUESTION 

a.  What  is  a  candidate  framework  for  understanding 
technical  management  oversight  of  international 
acquisition  and  how  might  that  framework  be 
applied  to  international  Air  and  Missile  Defense 
(AMD)  programs? 

This  question  is  answered  by  Chapter  III,  “Framework  for 
Teehnieal  Management  Oversight  (TMO)”  and  Chapter  IV,  “TMO 
Framework  Applied.”  The  write-ups  in  Chapter  IV  show  the  TMO 
framework  to  be  an  effeetive  tool  for  doeumenting  TMO  for  international 
programs. 

2.  SUBSIDIARY  RESEARCH  QUESTIONS 

a.  What  is  the  role  and  purpose  of  Technical 
Management  Oversight  for  acquisition? 

The  straightforward  answer  to  this  question  ean  be  found 
among  the  pages  doeumenting  interview  results  in  ehapter  IV: 

The  role  and  purpose  of  TMO  is  to  ensure  the  system  being 
developed  meets  the  User’s  needs. 

To  be  effeetive,  TMO  must  (1)  manage  teehnieal  resourees 
sueh  as  a  Researeh  Development  and  Engineering  Center  (RDEC)  and 
teehnieal  support  eontraetors;  (2)  manage  teehnieal  requirements  (3) 
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manage  risk;  (4)  monitor  contract  performance;  (5)  coordinate  User 
participation  when  necessary  in  the  development  process;  and  (6)  define 
technical  effort  within  contract  statements  of  work. 

b.  What  are  the  unique  international  TMO  issues  that 
must  be  jointly  addressed  by  the  participating  U.S. 
National  Program  Office  (NPO)  and  International 
Program  Office  (IPO)  managers  for  an  international 
system  acquisition? 

The  answers  to  this  question  can  be  found  among  the  pages 
documenting  interview  results  in  chapter  IV.  An  international 
development  program  involving  the  U.S.  may  include  one  IPO  and  an 
NPO  for  each  participating  nation.  The  IPO  will  have  primary 
responsibility  for  developing  the  system  and  managing  a  prime 
contractor,  similar  to  a  U.S.  only  program. 

Security  and  control  of  U.S.  technology  information  must  be 
addressed.  It  is  in  the  U.S.  interest  for  the  international  program  to  be 
successful,  but  information  that  reveal  vulnerabilities  of  other  systems 
must  be  protected.  The  U.S.  NPO  will  have  responsibility  to  ensure 
proper  authorizations  are  obtained  before  U.S.  information  is  transferred 
to  the  IPO. 

If  a  partial  release  of  sensitive  U.S.  information  is  planned, 
then  some  technical  support  and  separate  development  contracts 
managed  by  the  NPO  may  be  needed.  Coordinating  these  separate  but 
dependent  development  activities  with  the  primary  activity  is  critical. 

The  unique  U.S.  documentation  to  satisfy  the  U.S. 
acquisition  process  should  be  minimized. 

Early  involvement  of  the  U.S.  User  requires  careful 
coordination. 

The  NPO  must  help  the  U.S.  User  to  understand  whether  or 
not  U.S  requirements  are  incorporated  in  the  international  program. 


3 


Where  requirements  shortfalls  exist,  the  U.S.  NPO  must  eoordinate  with 
the  IPO  and  the  other  NPOs. 

D.  SCOPE  AND  LIMITATIONS 

The  seope  of  this  thesis  is  limited  to  TMO  for  internationally 
aequired  systems.  Programs  eonsidered  are  taetieal  missile  systems  or 
missile  defense  systems  managed  from  projeet  offiees  loeated  at  Redstone 
Arsenal  in  Alabama.  The  International  Spaee  Station  is  also  eonsidered. 
For  eaeh  program,  the  following  are  addressed: 

(1)  Exeeutive  Control 

(2)  National  Interaetion 

(3)  TMO  Funding 

(4)  TMO  Organizational  Aspeets 

(5)  Researeh,  Development  and  Engineering  Center 
(RDEC)  /  Contraetor  Teehnieal  Support 

(6)  Management  of  Teehnieal  Requirements 

(7)  Management  of  Teehnieal  Risk 

(8)  Teehnieal  Monitoring  Capability 

(9)  Direet  Teehnieal  Contribution 

( 1 0)  Control  of  and  Aeeess  to  Teehnieal  Data 

(11)  User  Partieipation 

(12)  Cost  Share/ Work  Share  Affeeting  TMO 

(13)  Preparation  of  Contraet  Statements  of  Work 

(14)  U.S.  Aequisition  Review  Prior  to  Next  Program  Phase 

The  following  are  not  addressed: 

(1)  Preparation  of  the  Operational  Requirements  Doeument  (ORD) 

(2)  Personnel  Management  Issues 

(3)  Group  Dynamies/ Leadership 
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(4)  Operational  Test  Issues 

(5)  Use  of  GOTS/COTS  vs  Developmental  Items 

(6)  Development  Methodologies 

(7)  Budget/ Finanee 

(8)  Earned  Value  Monitoring 

(9)  Contraets 

E.  RESEARCH  METHODOLOGY 

Researeh  investigation  ineluded  literature  searehes  and  detailed 
interviews  with  teehnieally  knowledgeable  program  leaders  in  past  and 
ongoing  international  programs.  The  literature  seareh  ineluded  the 
following: 

(1)  Regulatory  requirements  affeeting  TMO  for  U.S.  Aequisitions, 

(2)  International  program  eonsiderations,  and 

(3)  System  engineering  prineiples  and  praetiees. 

The  interviews  were  guided  by  a  eommon  framework  summarized 
in  Figure  1  and  detailed  later.  The  interviews  were  open-ended  teehnieal 
diseussions  intended  to  identify  issues  assoeiated  with  individual 
international  programs  and  to  identify  eommon  themes  between  the 
different  programs  eonsidered. 

F.  ORGANIZATION  OF  THE  STUDY 

The  thesis  is  organized  into  the  following  ehapters: 

Chapter  I:  Introduetion  —  Introduees  the  researeh  topie,  bounds 
the  diseussion  and  establishes  the  researeh  methodology. 

Chapter  II:  Literature  Seareh  -  Summarizes  pertinent  information 
to  establish  a  basis  for  diseussion.  Areas  reviewed  inelude  the  following: 
A.  Regulatory  Requirements 
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Figure  1:  Technical  Management  Oversight  Process 

B.  International  Considerations 

C.  System  Engineering  Prineiples 

Chapter  III:  TMO  Framework  —  Introduees  a  framework  for 
deseribing  TMO  within  an  international  program  and  deseribes  how  this 
framework  will  be  applied  to  the  programs  eonsidered  in  Chapter  IV. 

Chapter  IV:  Teehnieal  Management  Oversight  Framework  Applied 
—  Deseribes  teehnieal  management  oversight  for  several  past  and 
present  international  programs  using  the  framework  deseribed  in  ehapter 
III  as  a  guide.  Systems  seleeted  for  review  are  as  follows: 

A.  HAWK 

B.  ROLAND 

C.  LANCE 

D.  Medium  Extended  Air  Defense  System  (MEADS) 

E.  International  Spaee  Station  (ISS) 
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F.  Multiple  Launch  Rocket  System  (MLRS)  Tactical  Guided 
Warhead  (TGW) 

Chapter  V:  Analysis,  Conclusions  and  Recommendations  - 
Analyzes  and  Summarizes  lessons  learned  from  the  interviews.  For 
common  issues,  recommendations  are  suggested. 


G.  RECOMMENDATION  FOR  FURTHER  STUDY 

.  Investigate  the  international  programs  presented  in  this 
research  paper  from  the  perspective  of  the  international 
partner. 

•  Optimize  the  framework  presented  here  by  eliminating 
redundant  framework  elements  and  apply  this  framework  to 
Navy  and  Air  Force  programs. 

•  Take  each  element  of  the  International  TMO  Framework  and 
explore  in  a  more  in-depth  fashion  its  application  on  a  wide 
range  of  programs. 
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II.  LITERATURE  SEARCH 


A.  STATUTORY  AND 

REGULATORY  ENVIRONMENT 

1 .  Overview 

The  Executive  Branch  of 
Government  and  Congress 
establish  the  environment  for 
military  acquisition.  Congress 
authorizes  activities  and  provides 
funding  while  the  President 
establishes  his  priorities,  requests 
budgets  from  Congress  and 
executes  the  acquisition  process. 

The  roles  of  Congress  and  the 
President  are  established  by  the  Constitution  of  the  United  States. 
Following  budget  approval,  the  Executive  Branch  Department  of  Defense 
(DOD)  executes  the  defense  acquisition  process.  Laws  directly  affect  this 
process,  and  DOD  5000  Directives  and  Instructions  provide  a  framework 
for  acquisition.  The  Acquisition  Executive  (AE)  from  the  Army,  Navy,  Air 
Force,  or  the  Office  of  the  Secretary  of  Defense  (OSD)  is  responsible  to 
establish  the  specific  process  to  be  followed  by  each  acquisition  program. 

Table  1  highlights  perspectives,  responsibilities  and  objectives  of 
the  executive  branch  for  defense  acquisition. 


The  DoD  acquisition  system  exists 
to  secure  and  sustain  the  nation’s 
investments  in  technologies,  programs,  and 
product  support  necessary  to  achieve  the 
National  Security  Strategy  and  support  the 
United  States  Armed  Forces.  The 
Department’s  investment  strategy  must  be 
postured  to  support  not  only  today’s  force, 
but  also  the  next  force,  and  future  forces 
beyond  that.  The  primary  objective  of 
Defense  acquisition  is  to  acquire  quality 
products  that  satisfy  user  needs  with 
measurable  improvements  to  mission 
accomplishment  and  operational  support,  in 
a  timely  manner,  and  at  a  fair  and 
reasonable  price. 

(Introduction  to  Defense  Acquisition 
Management). 


2.  Program  Management 

For  each  acquisition  program  there  is  a  program  manager  with 
responsibility  for  executing  that  program.  The  program  manager  must 
obtain  approval  from  the  AE  for  an  acquisition  strategy,  request  a 
budget,  select  contractors,  manage  development  contracts,  report  to  the 
AE  and  report  to  congress,  and  mind  a  myriad  of  details.  The  Program 
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Table  1:  Executive  Branch  (from  DSMC  Introduction  to  Defense 

Acquisition  Management) 


Perspectives 

Responsibilities 

Objectives 

•  Formulate,  direct 
&  execute 

National  Security 
Policy 

•  Patriotism 

•  Personal 

Ambition 

•  Re-Election 

•  Sign  legislation  (President) 

•  Commander  in  Chief  (Pres) 

•  Negotiate  with  Congress 

•  Make  Decisions  for  Acquisition 
Programs  (Acquisition 

Executive) 

•  Issue  Directives/Regulatlons 

•  Contract  with  Industry 

•  Satisfy  National  Security 
Objectives 

•  Balanced  Force  Structure 

•  Field  Weapon  Systems  to 
Defeat  Threats  to  National 
Security 

•  Eliminate  Fraud  Waste  and 
Abuse  in  Federal 
Procurement 

Manager  (PM)  is  the  key  person  in  the  aequisition  proeess  for  eaeh 
program.  Figure  2  makes  this  plain.  This  is  the  program  environment  for 
a  domestie  defense  aequisition  program  involving  only  the  U.S.  While 
this  diagram  may  appear  eomplex,  it  is  relatively  elegant.  From  this 
diagram  it  ean  be  surmized  that  the  PM  for  a  domestie  U.S.  defense 
aequisition  program  is  eentral  to  program  exeeution. 

3.  Rules  of  the  Road 

DODD  5000.1,  DODI  5000.2  and  DOD  5000. 2-R,  hereinafter 
referred  to  eolleetively  as  DOD  5000,  set  forth  the  statutes  that  apply 
and  define  the  proeesses,  proeedures  and  guidelines  to  be  used  for 
aequisition  of  Major  Defense  Aequisition  Programs  (MDAPS). 

DOD  5000  has  evolved.  Sinee  1994  the  foeus  has  been  to  enable 
streamlined,  tailored  aequisition  while  providing  a  standardized 
framework  to  guide  all  DOD  aequisition.  The  DOD  5000  doeuments 
summarize  statutory  requirements  for  MDAPs  and  establish  DOD 
regulatory  requirements  for  MDAPs.  These  doeuments  provide  the  single 
set  of  guidanee  for  exeeution  of  all  DOD  aequisition.  Eaeh  program  is 
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Figure  2:  PM  Centric  Acquisition  (from  Introduction  to 
Defense  Acquisition  Management) 

expected  to  develop  an  acquisition  strategy,  for  approval  by  the  cognizant 
Milestone  Decision  Authority  (MDA),  that  establishes  how  the 
requirements  of  DOD  5000  will  be  met.  The  overall  “cradle  to  grave” 
acquisition  process  is  summarized  by  Figure  3. 

System  development,  occurs  primarily  following  milestone  B  during 
the  System  Development  and  Demonstration  phase  (SD&D).  Much  of  the 
guidance  in  DOD  5000  applies  to  TMO. 

a.  Significant  Statutes 

While  many  laws  have  been  written  that  influence  DOD 
system  acquisition,  a  few  that  are  worth  highlighting,  because  of  their 
influence  on  Technical  Management  Oversight.  The  Clinger-Cohen  Act 
(40  U.S.C.  1427)  requires  special  reporting  for  information  intensive 
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THE  5000  MODEL 


Single  Step  or 
Evolution  to  Full 


/  *^\  / 

Concept  & 
Technology 
Development 
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&  Demonstration 
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Deployment 
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Relationship  to  Requirements  Process 


Sustainment 
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Figure  3:  The  DOD  5000  Acquistion  Model  (From  DODD  5000.1) 


systems  and  requires  coordination  in  order  to  ensure  development  of 
effective  information  exchange  capabilities.  The  National  Environmental 
Policy  Act  (NEPA)  (42  U.S.C.  4321-4370d)  directly  affects  system 
development  because  of  legal  constraints  placed  on  the  use  of  hazardous 
and  environmentally  damaging  substances  and  materials.  Similarly,  the 
Occupational  Safety  and  Health  Act  (OSHA)  (42  U.S.C.  4321-4370d) 
constrains  system  design.  Legal  mandates  for  independent  system 
testing  are  contained  in  10  USC  2399(b)(1),  "Operational  Test  and 
Evaluation.” 


h.  Guidance 

DOD  5000  regulates  the  establishment  of  tailored  MDAP 
acquisition  programs  and  establishes  mandatory  procedures  for  MDAPs. 
There  is  some  ambiguity  about  what  guidance  applies  to  International 
programs,  except  for  the  specific  international  program  guidance.  For 
example,  the  Internationa  program  section  of  DOD  5000. 2-R  makes  the 
military  services  responsible  to  ensure  the  Operational  Requirements 
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Document  (ORD);  the  Command,  Control,  Communieations,  Computers 
and  Intelligenee  Support  Plan  (C4ISP);  the  Test  and  Evaluation  Master 
Plan  (TEMP)  and  the  Aequisition  Program  Baseline  (APB)  doeuments  are 
properly  staffed  for  international  programs.  The  following  paragraphs 
highlight  mandatory  proeedures  that  have  a  direet  bearing  on  Teehnieal 
Management  Oversight  for  MDAPS.  To  understand  the  degree  of 
mandate  assoeiated  with  an  international  program,  eareful  revue  should 
be  made  of  DOD  5000  and  the  legally  binding  referenees  in  the 
applieable  international  Memorandum  of  Understanding. 

(1)  Program  Goals  should  be  well  established  in  an 
APB  ineluding  thresholds  and  objeetives  for  eost,  sehedule  and 
performanee.  Consequenees  for  not  meeting  the  APB  should  be  elearly 
established.  Cost  As  and  Independent  Variable  (CAIV)  aetivity  should  be 
performed  to  enable  trade-offs  between  system  requirements,  eost  and 
sehedule.  This  aetivity  should  be  done  in  elose  eoordination  with  the 
system  user. 


(2)  An  Aequisition  Strategy  should  be  developed  early 
in  the  program  and  updated  for  eaeh  subsequent  program  phase.  This 
doeument  tailors  DOD  5000  to  eaeh  MDAP  an  is  a  eontraet  between  the 
Program  Manager  and  the  Aequisition  Exeeutive  that  establishes  how  the 
program  will  be  exeeuted.  Eleetronie  data  exehange  is  deseribed.  The 
programs  approaeh  to  management  of  people,  funding,  risk,  staffing, 
eontraeting  and  oversight  are  deseribed.  Speeial  eonsiderations  for 
simulation  based  aequisition,  software  develoment,  the  teehnieal 
management  approaeh  and  business  strategy  are  all  deseribed. 

(3)  The  program’s  approaeh  to  Test  and  Evaluation 
should  eoordinate  Developmental  Testing  (DT)  and  Operational  Testing 


13 


(OT).  DT  and  OT  obtjectives  should  be  placed  in  the  Test  and  Evaluation 
Master  Plan  (TEMP),  which  is  a  required  document  for  all  MDAPs.  Plans 
should  be  established  for  information  technology  security  certification, 
interoperability  certification,  information  assurance  testing,  development 
of  model  and  simulations  that  are  validated  against  real  test  data  and 
anti-tamper  verification  testing. 

(4)  Considerations  for  System  Engineering  drawn  from 
technical  literature  are  described  later  in  chapter  II  section  C,  however, 
guidance  is  provided  in  DOD  5000. 2-R  that  is  comprehensive. 
Considerable  guidance  is  provided  for  management  of  technical  risk, 
requirements,  open  systems  design,  software  develoment,  design  for 
supportability,  quality  and  configuration  management. 

(5)  Other  Guidance  from  DOD  5000. 2-R  covers  topics 
of  information  superiority;  Reliability,  Availability,  Maintainabiliy  (RAM); 
interoperability,  insensitive  munitions,  corrosion  prevention  and  control, 
electromagnetic  effects  and  spectrum  supportability,  required  reviews,  ... 
and  so  forth. 

B.  INTERNATIONAL  CONSIDERATIONS 

1 .  Overview 

The  primary  source  of  information  for  this  section  is  the  research 
report  by  Catington,  Knudson  and  Yodzis  entitled  “Transatlantic 
Armaments  Cooperation.”  They  note  that  transatlantic  international 
cooperative  development  of  weapon  systems  during  the  past  40  years  has 
been  done  in  order  to  distribute  costs  for  weapon  systems  development, 
to  leverage  technology  from  partner  nations  and  to  improve 
interoperability  among  partner  systems.  These  goals  are  complicated  by 
the  conflicting  national  politics,  protection  of  the  industrial  base. 
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protection  of  technology,  national  priorities,  requirements  harmonization, 
the  implementation  of  the  partnership,  and  culture.  The  importance  of 
an  international  Memorandum  of  Understanding  (MOU)  that  establishes 
an  agreement  for  the  nature  and  extent  of  an  international  MDAP  cannot 
be  over-emphasized.  Figure  4  summarizes  the  considerations  for  an 
international  MDAP  that  are  discusses  in  this  chapter. 


Requirements 


Figure  4:  International  Considerations 


2.  Politics 

National  politics  drive  conflicting  desires  of  each  participant  to 
minimize  expenditures  while  maximizing  the  local  benefit.  The  desire  to 
minimize  expenditures  combined  with  the  need  for  interoperability  opens 
the  door  to  international  cooperation.  However,  the  desire  to  maximize 
local  investment  greatly  complicates  management  because  balancing  of 
workload  must  be  accomplished.  When  the  concept  of  noble  work-share 
is  established,  this  complicates  matters  even  more.  Then,  not  only  must 
the  workload  be  balanced,  but  the  work  must  be  seen  as  meaningful  by 
each  partner. 
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Separate  national  politieal  proeesses  reduee  program  stability, 
beeause  eaeh  partner  nation  must  gain  politieal  support  for  funding. 

The  deeision  proeesses  are  different,  may  not  be  synehronized,  and  may 
be  strongly  affeeted  by  National  eleetions.  New  Government 
administrations  may  require  time  to  establish  funding  priorities,  and 
they  may  not  agree  with  the  funding  priorities  of  past  national 
administrations.  During  the  time  that  separate  national  funding 
deeision  proeesses  are  under  way,  uneertainty  ean  be  expeeted.  Who 
knows  if  program  partieipation  by  eaeh  nation  will  eontinue?  However, 
there  is  a  pair  of  stabilizing  influenees:  The  desire  for  sueeess  onee 
started;  and  an  aversion  to  being  identified  as  the  nation  that  quit. 
National  pride  is  at  stake.  However,  the  nature  of  the  threat  ehanges, 
war-fighting  doetrine  or  national  priorities  ehange,  a  partner  nation  may 
eease  to  have  a  need  for  the  system.  In  that  ease,  politieal  support  would 
probably  be  unsustainable. 

3.  Economics 

Economies  is  the  foundation  that  makes  programs  possible.  What 
often  makes  international  MDAPs  economically  unique  as  compared  to 
domestic  MDAPS  are  the  agreements  for  sharing  of  costs  and  work, 
multiple  funding  decision  processes  and  exchange  rates.  Multiple 
national  economies  influence  availability  of  funds.  The  general  economic 
health  of  industry  within  each  country  may  affect  the  ability  of  the 
countries  to  participate.  Exchange  rates  may  become  an  issue.  If 
international  monetary  exchange  rates  fluctuate  over  the  life  of  a 
program,  then  the  countries  may  pay  more  or  less  than  expected. 

4.  Requirements 

Harmonizing  requirements  for  an  international  MDAP  is  perhaps 
the  most  important  activity,  and  it  is  not  an  easy  process.  Nations  have 
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differing  interests  and  priorities.  Threat,  need  date,  funetions  to  be 
performed  (mobility,  threat  deteetion  eapability,  eommunieations,  speed, 
automation,  ete),  eharaeteristies  (aeeuraey,  display/ labeling  language, 
weight,  size,  transportability,  ete.  ),  and  required  operational 
environments  must  be  harmonized.  National  laws  and  regulations  may 
eonfliet.  Fortunately  DOD  now  mandates  the  use  of  performanee  based 
requirements  and  speeifieations,  whieh  make  international  MDAPs  more 
possible.  The  streamlining  of  aequisition  through  use  of  eommereial 
standards  and  performanee  speeifieations  is  gaining  favor  outside  of  the 
U.S.  DOD  as  well  as  within.  This  emerging  eommon  approaeh  helps  as 
partners  harmonize  program  requirements.  Additionally,  understanding 
the  needs  of  the  partner  nations  is  essential  to  making  needed 
eompromises. 

Capability  not  needed  by  one  nation  will  be  opposed  by  that  nation 
in  an  effort  to  hold  down  eost.  Capability  pereieved  as  important  by  that 
nation  will  be  vigorously  promoted.  The  differenees  must  be  negotiated, 
and  there  is  no  assured  resolution  of  any  differenee.  One  way  to  address 
this  issue  is  the  ereation  of  national  variants  with  tailored  end  items 
built  around  eommon  eore  eapability.  Establishing  Key  Performanee 
Parameters  (KPPs),  a  set  of  agreed  essential  requirements,  is  important. 
These  KPPs  define  the  potential  trade  spaee  for  Cost  As  an  Independent 
Variable  (CAIV)  tradeoffs  when  test  results  emerge  and  as  eosts  beeome 
better  understood.  Agreeing  on  the  time  frame  for  development  and  the 
extent  of  international  variants  of  the  eore  system  are  important  as  well. 

5.  Security 

Seeurity  for  an  international  MDAP  is  both  eolleetive  and 
individual.  The  effeetiveness  of  a  military  system  often  depends  on 
denying  potential  adversaries  aeeess  to  system  vulnerability  information. 
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Thus,  it  is  in  the  common  interest  of  the  partners  to  protect  system 
information  that  may  reveal  vulnerabilities. 

The  U.S.  may  bring  technologies  into  the  cooperative  effort  that  it 
considers  to  be  advanced,  and  may  be  unwilling  to  fully  disclose  these 
technologies.  Access  to  some  technology  may  be  restricted  to  “black  box” 
devices  where  the  inputs  and  outputs  are  advertised,  but  the  internal 
design  or  manufacturing  details  are  not  divulged.  In  the  case  of 
advanced  computer  algorithms,  software  source  code  may  not  be 
divulged,  only  the  executable  code.  Partner  nations  may  be 
uncomfortable  with  this,  however,  it  should  be  kept  in  mind  that 
protection  of  information  even  within  a  one  nation  development  activity  is 
not  unusual.  For  developments  involving  more  than  one  company, 
detailed  design  and  process  information  is  often  with-held  from  other 
companies  by  the  owning  company  to  protect  company  interests. 

The  U.S.  has  policies  that  establish  a  security  framework  for  U.S. 
participation  in  international  MDAPS,  including  processes  for  the 
transfer  of  technology  to  foreign  entities.  The  DOD  security  directives 
that  apply  are  DOD  Directive  (DODD)  5230.11,  DODD  5230.20  and 
DODD  5000.39.  Technology  transfers  are  governed  by  the  International 
Traffic  in  Arms  Regulations  (ITAR)  and  DODD  2040.2.  Industrial 
security  policy,  which  the  participating  companies  must  follow,  is 
established  in  the  National  Industrial  Security  Operating  Manual 
(NISPOM).  The  document  that  will  establishes  security  procedures  once 
information  is  within  the  program  is  the  Program  Security  Instruction 
(PSI),  which  will  be  unique  to  each  international  MDAP  and  must  be 
agreed  to  by  all  national  partners. 
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6.  Management 

Historically,  cooperative  international  developments  have  involved 
similar  management  struetures,  as  shown  in  Figure  5,  with  variations  on 


Figure  5:  Generic  International  MDAP  Structure 


the  theme.  Typieally,  an  international  steering  eommittee,  eonsisting  of 
senior  military  or  eivilian  deeision-makers,  oversees  the  development 
program.  The  Steering  Committee  may  or  may  not  employ  an  exeeutive 
management  subeommittee  to  eoordinate  day  to  day.  An  international 
projeet  offiee  will  manage  the  program  and  a  prime  eontraetor  will  design 
and  build  the  system,  partieipating  in  some  aspeets  of  development  and 
integration,  and  managing  subeontraetor  aetivity. 

Within  this  eoneeptual  management  framework,  variations  oeeur. 
In  many  eases  the  U.S.  provides  the  largest  individual  share  of  funding, 
but  has  an  equal  vote  with  eaeh  other  partner  on  the  Steering 
Committee.  In  some  eases  the  U.S.  has  been  given  leadership  for 
management  of  the  International  Projeet  Offiee  (IPO)  effort  and  is 
responsible  for  managing  the  development  and  eoordinating  with  support 
provided  by  partner  nations.  This  approaeh  has  proven  effeetive,  and 
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from  the  point  of  view  of  the  U.S.  is  fair  when  the  U.S.  provides  the 
largest  share  of  funding.  However,  the  partner  nations  often  prefer  to 
have  a  more  even  distribution  of  responsibilities.  In  some  eases, 
program  leadership  is  shared  or  rotated  between  partner  nations.  It  has 
also  been  shown  that  this  approaeh  ean  be  effeetive.  Regardless  of  the 
assignment  of  responsibilities  for  eaeh  nation,  the  agreements  made 
early  are  important,  beeause  they  tend  to  remain  throughout  the  life  of 
the  program. 

7.  Industry 

Industrial  arrangements  between  eompanies  partieipating  in  the 
development  and  produetion  vary  widely  for  eooperative  international 
development  as  with  domestie  U.S.  development.  The  nature  of  these 
arrangements  will  depend  on  the  guidanee  provided  by  the  partner 
nations  during  solieitation  and  on  the  industrial  agreements  that  the 
winning  eontraetor  is  able  to  negotiate  with  partner  eompanies.  Many 
are  the  possibilities. 

8.  National  Acquisition  Processes 

The  eontext  for  an  international  eooperative  development  makes  a 
diffieult  aetivity  more  diffieult.  The  development  aetivity  must  satisfy  the 
authorizing  bodies  of  eaeh  partieipating  nation  in  order  for  that  nation  to 
eontinue  partieipation.  Eaeh  partner  nation  will  have  a  bureaueraey 
that  needs  information  and  demands  to  be  heard.  Seetion  A  of  this 
ehapter  highlights  the  DOD  5000  guidanee  that  affeets  U.S.  programs. 

It  is  elear  that  U.S.  laws  and  regulations  must  be  followed  by  U.S. 
leadership  in  the  negotiations  to  strueture  an  international  eooperative 
development.  However,  it  is  not  always  elear  whieh  legal  and  regulatory 
requirements  must  be  followed  during  the  exeeution  of  an  international 
program,  espeeially  if  the  different  partieipant  nations  have  different  legal 
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and  regulatory  requirements.  Onee  signed,  a  Memorandum  Of 
Understanding  (MOU)  between  Nations  establishing  an  agreement  for  the 
eonduet  of  a  development  effort  will  generally  take  preeedenee.  The 
diffieulty  of  satisfying  the  aequisition  proeesses  for  the  partieipating 
nations  inereases  with  the  number  of  partieipants. 

9.  Culture 

Differing  national  eultures  and  norms  of  behavior  affeet  day  to  day 
program  operations.  Early  effort  is  needed  to  build  trust  and 
understanding  between  partieipants.  This  may  seem  trivial,  but  may 
make  the  differenee  between  whether  team  members  eooperate  or  fight. 
Nation  A  partieipants  may  be  aeeustomed  to  rigid  organizational  eontrol 
and  individual  eonformanee.  Nation  B  partieipants  may  be  aeeustomed 
to  a  more  relaxed  approaeh.  Nation  C  partieipants  may  be  aeeustomed 
to  a  greater  degree  of  delegation  of  authority,  . . .  these  eonsiderations 
apply  to  any  organized  aetivity.  However,  for  international  programs,  the 
importanee  of  getting  along  and  working  together  is  even  higher  beeause 
of  the  diffieulty  in  resolving  differenees.  A  problem  between  two 
individuals  eould  be  interpreted  as  a  problem  between  two  national 
partners,  whieh  ultimately  might  lead  to  one  or  more  nations  quitting  the 
program.  Cultural  differenees  are  not  only  ehallenges  for  eaeh 
individual,  but  also  for  eaeh  nation’s  team. 
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C.  SYSTEM  ENGINEERING  PRINCIPLES 


1 .  Overview 

For  a  major  undertaking, 
development  eomplexity  is  enormous. 
Figure  6  suggests  the  magnitude  of  the 
effort.  This  system  engineering  review 
lays  the  foundation  for  the  TMO 
framework  definition  that  follows. 

This  seetion  is  not  intended  as  a 


“Would  you  tell  me,  please,  which  way  I 
ought  to  go  from  here?” 

“That  depends  a  good  deal  on  where 
you  want  to  get  to,”  said  the  Cat. 

“I  don’t  much  care  where _ ”  said 

Alice. 

“Then  it  doesn’t  matter  which  way  you 
go,”  said  the  Cat. 

“ _ so  long  as  I  get  somewhere,” 

Alice  added  as  an  explanation. 

“Oh,  you’re  sure  to  do  that,”  said  the 
Cat,  “if  you  only  walk  long  enough.” 

Lewis  Carroll,  Alice  in  onderland,,1865 


Products/  System  Elements 


Processes 


Figure  6:  System  Engineering  Products  and  Processes  (From  Grin 

Marvel  Lecture  Notes) 


comprehensive  presentation  on  system  engineering;  but  rather,  it  is 
intended  to  provide  a  summary  of  basie  system  engineering  prineiples,  to 
support  the  later  material. 
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2.  Development  of  Complex  Systems 

System  engineering  has  emerged  as  a  diseipline  for  managing 
development  of  eomplex  systems.  The  evolution  of  the  diseipline 
parallels  the  advaneement  of  human  eivilization.  Soeial  systems  emerged 
with  speeialization  sueh  as  food  gathering,  hunting,  defense,  leadership, 
ete.  The  building  of  eomplex  struetures,  sueh  as  houses,  palaees, 
tunnels,  pyramids,  bridges  and  weapons  resulted  in  speeialization  as 
well.  The  proeesses  may  not  have  been  thought  of  as  system 
engineering,  it  was  organized  human  aetivity  in  the  struggle  to  survive. 
Yet,  it  was  system  engineering.  The  methods  used  enabled  development 
of  systems  that  no  one  person  eould  build  or  fully  understand.  The 
differenees  are  that  now  we  have  generalized  the  idea  of  system 
engineering,  doeumented  repeatable  proeesses,  inereased  speeialization, 
and  we  now  have  automated  tools  to  help  us  manage  information. 


3.  Aspects  of  System  Engineering 

Table  2  lists  30  aspeets  of  system  engineering.  For  development  of 
eomplex  systems,  many  people  are  involved.  How  they  exehange 
information  and  make  deeisions  impaets  program  sueeess. 


Table  2:  System  Engineering  Considerations  (from  Howard  Eisner) 


1.  Requirements: 
Needs/Goals/Objectives 

2.  Requirements:  Mission 
Engineering 

3.  Requirements 
Analysis/Allocation 

4.  Functional  Analysis/Allocation 

5.  Architecture  Design/Synthesis 

6.  Alternatives 
Analysis/Evaluation 

7.  Technical  Performance 
Measurement  (TPM) 

8.  Life  Cycle  Costing 

9.  Risk  Analysis 

10.  Concurrent  Engineering 


1 1 .  Specification  Development 

12.  Hardware/Software/Human 
Engineering 

13.  Interface  Control 

14.  Computer  Tool  Evaluation 
and  Utilization 

15.  Technical  Data  Management 

16.  Integrated  Logistics  Support 

17.  Reliability,  Availability, 
Maintainability 

18.  Integration 

19.  Test  and  Evaluation 

20.  Quality  Assurance  and 
Management 


21.  Configuration  Management 

22.  Specialty  Engineering 

23.  Preplanned  Prod 
Improvement  (P3I) 

24.  Training 

25.  Documentation 

26.  Production 

27.  Installation 

28.  Operations  and  Maintenance 

29.  Operations  Evaluation/ 
Reengineering 

30.  Systems  Engineering  Mgmt 
(Planning,  Organizing,  Directing, 
Monitoring) 
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4.  Evolution  of  System  Engineering 

The  understanding  of  system  engineering  prineiples  has  evolved. 
During  the  industrial  revolution,  Edison  developed  systems  using  new 
teehnologies  involving  eleetrieity,  aeousties  and  novel  materials.  During 
his  time  there  was  no  reeognized  system  engineering  diseipline.  Yet  he 
had  to  grapple  with  the  issues  embodied  in  table  2.  Edison  understood 
the  importanee  of  good  eommunieations  in  industrial  researeh  and 
aeeess  to  information  and  materials.  A  library  was  eentral  to  his 
laboratory.  Also,  he  was  a  praetieal  man.  He  was  onee  heard  saying, 
“The  most  important  part  of  an  experimental  laboratory  is  a  big  serap 
heap.”  He  understood  the  value  of  speeialization  and  independent 
initiative:  “Hell,  there  ain’t  no  rules  here!  We're  trying  to  aeeomplish 
something!”  Work  at  his  invention  faetory  took  no  heed  of  the  eloek.  He 
gave  workers  a  sense  of  shared  identifieation  with  his  goals  (Millard). 

Yet,  while  Edison  may  have  had  an  innate  understanding  of  system 
engineering  prineiples,  his  homegrown  brew  of  methods  was  dependent 
on  his  personal  genius  and  ability  to  inspire  others.  Commonly 
aeeepted  system  engineering  standards  did  not  exist. 

5.  Psychology  of  System  Engineering 

System  engineering  evolved  beeause  of  a  duality:  The  human 
desire  to  survive  eoupled  with  human  limitations.  Studies  in  psyehology 
have  shown  that  short-term  memory  is  at  the  root  of  our  ereative 
abilities.  However,  at  one  time  we  ean  retain  only  five  to  seven  separate 
objeets  in  our  short-term  memory.  Long  term  memory  has  mueh  more 
eapaeity,  however,  it  is  slow  and  mueh  less  aeeurate.  These  limitations 
ean  be  overeome  by  organized  eooperative  efforts  involving  speeialists. 

People  are  able  to  know  a  lot  about  a  few  topies,  or  a  little  bit  about  a 
lot  of  topies.  For  example,  a  neuro-opthemologist  knows  a  lot  about 
eyes,  the  optie  nerve  and  the  visual  eortex,  but  is  unlikely  to  know  mueh 
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Breadth  of  Knowledge 


about  road  construction. 
Knowledge  ean  be  deep  or  it 
ean  be  wide.  This  is  depieted 
in  Figure  7. 


6.  System 

Engineering 
Standards 

System  engineering  is 
an  organized  approaeh  to 
managing  the  development  of 
eomplex  systems. 

Standardized  methodologies 
are  eaptured  in  the  Eleetronie  Industries  Assoeiation  (ElA)  standard  IS- 
632,  and  Institute  of  Eleetrieal  and  Eleetronies  Engineers  (IEEE) 
standard  P1220.  These  standards  have  their  genesis  in  DOD  Standard 
499.  The  definition  of  system  engineering  from  eaeh  of  these  standards 
is  deseribed  in  Table  3. 


O.  Grady) 


Table  3:  System  Engineering  Definitions  (From  MIL  STD  499A, 
EIA  Standard  IS-632  and  IEEE  Standard  PI 220) 


EIA  Standard  IS-632,  Systems 
Engineering 


MIL  STD  499A,  Engineering 
Management  (Now  Cancelled) 


A  logical  sequence  of  activities  and 
decisions  transforming  an 
operational  need  into  a  description 
of  system  performance  parameters 
and  a  preferred  system 
configuration. 


An  interdisciplinary  approach 
encompassing  the  entire  technical 
effort,  to  evolve  into  and  verify  an 
integrated  and  life  cycle  balanced  set 
of  system  people,  products,  and 
process  solutions  that  satisfy 
customer  needs. 


IEEE  PI 220,  Standard  for 
Application  and  Management 
of  the  Systems  Engineering 
Process 

An  interdisciplinary, 
collaborative  approach  to 
derive,  evolve  and  verify  a  life 
cycle  balanced  systemsolution 
which  satisfies  customer 
expectations  and  meets  public 
acceptability. 


25 


7.  Department  of  Defense  View 

Figure  8  depicts  the  DOD  system  engineering  process  diagram.  In 
this  diagram,  a  function  called  “SE  Anal  &  Cntrl”  is  segregated  from  the 
other  activities,  intended  to  emphasize  that  analysis  and  control 
apply  to  each  of  the  three  system  engineering  activities.  Verification  is 
shown  as  a  loop  between  “Synthesis”  and  “Requirements  Analysis.” 


Figure  8:  DOD  System  Engineering  Process 
(From  DSMC  System  Fundamentals) 


Table  4  describes  the  system  engineering  activities  shown  in  Figure  8. 
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Table  4:  System  Engineering  Definitions  (From  DSMC  System 

Engineering  Fundamentals) 


Requirements  Development 

Define  Requirements 

Ensure  Completeness 

Logical  Completeness 

Constraints  Identified  (such  as 
environment) 

Functions  Identified 

Applicable  Standards  Identified 
Ensure  Testability 

Functional  Analysis  and  Allocation 

Decomposition  of  Functions  to  lower  level 
Define  a  functional  architecture,  which 
associates  the  lower  level  functions 
Develop  Interface  Requirements  for  the 
functions 

Synthesis 

Transform  the  functional  architecture 
into  alternative  physical  architectures 
Define  candidate  objects  (physical 
elements)  for  the  system 

Do  Trade  studies  to  select  the  preferred 
physical  architecture  and  objects 

Define  the  physical  interfaces 

Design  the  System 

Validation  and  Verification 

Validation 

Requirements  are  correct  and  achievable 
Requirements  have  been  satisfactorily 
allocated 

Verification 

Design  satisfies  the  requirements 

System  is  implemented  according  to  the 
design 

8.  Relationship  of 
Requirements  to  Test 

Dividing  the  system 
engineering  proeess  into  sub- 
proeesses  provides  a  means 
to  partition  the  larger 
proeess  into  distinet, 
manageable  inter-related 
proeesses.  The  V  diagram, 
Figure  9,  emphasizes  the 
relationship  between 
requirements  and  test 
aetivities.  Looking  at  this 
diagram  it  is  easy  to  visualize 


Customer 

Need 


Product 


Figure  9:  System  Engineering  “V”  Diagram 
(From  Orin  Marvel  Lecture  Notes) 


the  effeet  of  an  error  in  system  requirements,  inereasing  the  need  to  do 
up  front  work,  sueh  as  modeling  and  simulation,  to  ensure  system 


requirements  are  eorreet  and  aehievable. 
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9.  Early  Commitment  of  Resources 

The  Committed  versus 
Aetuals  diagram,  Figure  10, 
highlights  the  effeet  of 
requirements  and  design 
deeisions  made  early  in  a 
projeet.  What  this  diagram  is 
showing  is  that  deeisions 
made  early  affeet  the  work 
(and  thus  the  eost)  to  be  done 
later.  This  provides  further 
motivation  to  ensure  the 
requirements  are  reasonable 
before  initiating  design  and 
fabrieation. 


Figure  10:  Committed  vs  Actuals  (From 
Orin  Marvel  Lecture  Notes) 


10.  Spiral  Development 

For  any  system,  improvements  ean  be  made  over  time.  This 
applies  to  all  system  aspeets:  Requirements,  design,  fabrieation, 
maintenanee,  training,  ete.  Sometimes  it  is  desirable  to  plan  for 
improvement  over  time,  espeeially  if  the  system  being  developed  is 
unfamiliar.  Figure  1 1  depiets  a  spiral  development  proeess  where 
multiple  iterations  of  system  development  oeeur.  The  iterations  are 
planned  in  advanee,  in  reeognition  that  it  will  not  be  possible  obtain  the 
best  solution  the  first  time  through  the  development  eyele. 
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Figure  11:  Spiral  Development  (From  Jeffrey  O. 

Grady) 

11.  Five  Habits  of  a  Successful  Project 

Development  of  a  major  system  is  diffieult,  uneertain,  requires 
ereativity  to  overeome  risk,  and  requires  eonstant  foeus  on  essentials. 
Five  habits  of  a  sueeessful  projeet,  based  on  leetures  from  Dr.  Orin 
Marvel  at  the  Naval  Postgraduate  Sehool  and  writings  from  Grady  Booeh 
are  listed  in  Table  5. 

Major  system  development  involves  eomplexity  that  must  be 
managed.  The  development  team  should  work  to  one  integrated  set  of 
requirements  and  proeesses.  A  System  Engineering  Management  Plan 
(SEMP)  should  be  developed  to  form  the  basis  for  an  overall  projeet  plan 
and  integrated  master  sehedule.  Risk  should  be  evaluated  and  resourees 
assigned  aeeordingly  to  investigate  alternative  solutions.  Before  large 
investments  are  made  to  develop  eomplex  solutions  in  hardware  and 
software  for  the  system  or  any  level  of  subsystems,  eonfidenee  should  be 
gained  through  analysis,  modeling,  simulation  and  prototype 
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Table  5:  Five  Habits  of  a  Successful  Project  (from  Orin  Marvel 
at  the  Naval  Postgraduate  School  and  writings  from  Grady 

Booch) 


1 .  A  ruthless  focus  on  the  development  of  a  system  that  provides  a  well  understood  collection  of 
essential  minimal  characteristics; 

2.  The  existence  of  a  culture  that  is  centered  on  results,  encourages  communication  and  yet  is  not 
afraid  to  fail; 

3.  The  effective  use  of  modeling  and  simulation; 

4.  The  existence  of  a  strong  architectural  vision; 

5.  The  existence  of  a  well  managed  iterative  and  incremental  life  cycle. 

development.  Teehnieal  Performanee  Measures  (TPMs)  should  be 
established  early,  to  be  used  as  metries  during  the  development  effort,  to 
traek  how  well  the  design  satisfies  the  requirements. 

12.  Organization 

The  strueture  of  a  development  organization,  and  eommunieation 
proeesses  within  the  organization  are  important  to  sueeessful  system 
development.  Eisner  suggests  that  a  projeet  organization  should  be 
headed  by  a  projeet  manager  with  the  key  subordinates  of  Chief  System 
Engineer  and  Controller.  The  program  manager  has  overall 
responsibility  for  sueeessful  exeeution  of  the  program,  but  his  foeus  is 
primarily  outward,  with  the  goal  of  ensuring  that  eustomer  needs  are 
met.  The  role  of  the  ehief  system  engineer  is  to  eoordinate  efforts  of  all 
the  engineers  in  the  projeet  to  ensure  that  an  optimal  teehnieal  solution 
is  aehieved.  The  role  of  the  eontroller  is  to  manage  the  business  of  the 
projeet  sueh  as  eontraets,  sehedules  and  finanees.  He  ealls  these  three 
key  projeet  individuals  the  triumvirate,  with  overlapping  responsibilities 
(Eisner  pp  14-16,  24).  At  lower  levels,  a  program  may  be  organized  along 
produet  lines  or  by  funetions.  Partieipants  may  be  dedieated  to  the 
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project  or  matrixed  from  a  functional  organization.  In  any  case,  there  is 
a  mapping  of  skills  to  the  defined  system  engineering  process  and  the 
defined  tasks.  For  complex  programs,  formal  coordination  will  be 
necessary.  However,  informal  communications  is  often  the  best  way  to 
foster  creativity  and  innovation. 

System  engineering  involves  a  coordinated  set  of  processes  with 
engineering  practitioners  from  a  multitude  of  disciplines.  For  a  large 
project,  no  one  person  can  know  everything  there  is  to  know  about  the 
project.  This  makes  establishment  of  a  clear  system  engineering  process 
imperative.  Standards  in  use  today  that  define  tailorable  processes  for 
application  to  various  programs.  Current  standards  are  based  on 
previous  military  standards.  Military  standards  for  system  engineering 
have  been  superceded  by  commercial  standards.  Table  6  lists  several 
system  engineering  standards  and  texts  that  are  applicable  to 
development  of  complex  systems. 

Table  6:  Widely  Used  System  Engineering  Standards  and  Texts 

1 .  EIA  Standard  IS  -  632  System  Engineering 

2.  IEEE  P1220  Standard  for  Systems  Engineering 

3.  MIL-STD-961D  Defense  Specifications 

4.  System  Engineering  Fundamentals,  Defense  Systems  Management 
College  (DSMC),  1999 

5.  System  Engineering  Management,  Benjamin  S.  Blanchard,  1998 

6.  System  Architecting,  Eberhardt  Rechtin,  1991 

7.  System  Validation  and  Verification,  Jeffrey  O.  Grady 

8.  Strategies  for  Real  Time  System  Specification,  Hatley  and  Pirbhai 


31 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


32 


III.  TECHNICAL  MANAGEMENT  OVERSIGHT  FRAMEWORK 


A.  TECHNICAL  MANAGEMENT  OVERSIGHT 

This  chapter  defines  Teehnieal  Management  Oversight  (TMO)  and 
the  framework  that  will  be  used  in  ehapter  IV  to  eharaeterize  TMO  for 
several  international  Major  Defense  Aequisition  Programs  (MDAPs). 

TMO  is  teehnieal  management,  from  the  eustomer  perspeetive.  It 
helps  the  eustomer  to  get  his/her  “money’s  worth.”  Creating  a  new 
system  requires  partnership  between  the  prime  eontraetor  engineers  and 
the  eustomer  TMO.  The  TMO  aetivity  defines  the  work  to  be  performed 
and  the  system  to  be  built,  then  eertifies  that  the  system  developed 
meets  the  needs  of  the  Users.  The  prime  eontraetor,  with  direet  eontrol 
of  seientists,  engineers  and  teehnieians,  will  ereate  a  system  where  no 
system  existed  before.  For  eomplex  programs,  risk  may  be  shared  and 
there  may  be  a  degree  of  eollaboration  between  the  eustomer  and  the 
prime  eontraetor.  However,  the  prime  eontraetor  remains  responsible  for 
produeing  the  system,  and  the  TMO  aetivity  remains  responsible  to  verify 
that  the  teehnieal  performanee  requirements  have  been  met. 

Looking  to  prime  eontraetor  development,  TMO  involves  system 
engineering,  but  not  the  same  system  engineering  that  is  done  by  the 
prime  eontraetor.  Seetion  B  of  this  ehapter  deseribes  a  TMO  framework 
is  be  used  to  highlight  TMO  aetivities  that  are  eentral  to  Major  Defense 
Aequisition  Programs  (MDAPs)  and  that  may  be  used  for  understanding 
TMO  for  international  programs.  Looking  outward,  the  international 
eustomers  must  be  eonvineed  of  program  sueeess.  From  the  U.S. 
perspeetive,  the  U.S.  aequisition  proeess  must  be  satisfied  in  order  to 
eontinue  into  the  next  aequisition  phase. 
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B.  FRAMEWORK 

A  framework  for  describing  TMO  is  shown  in  Figure  12.  The 
framework  includes  the  U.S.  acquisition  review  process  in  the  context  of 
an  international  program.  Although  equally  important,  the  acquisition 


Figure  12:  International  Technical  Management  Oversight 

Framework 


review  processes  for  partner  nations  is  not  included  as  part  of  this  thesis. 
This  limitation  allows  focus  on  the  U.S.  aspects  of  TMO  for  an 
international  MDAP  and  limits  the  scope  of  the  thesis. 

C.  TMO  CONSIDERATIONS 

1 .  TMO  Organizational  Aspects 

TMO  Organizational  Aspects  represent  the  external  and  internal 
organization  considerations  that  affect  TMO  for  the  activity.  Externally, 
the  relationship  of  the  International  Program  Office  to  its  national 
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sponsors  is  described.  Internally,  the  IPO  organization  structure  is 
described. 

2.  Research  Development  and  Engineering  Center 

(RDEC)/ Contractor  Technical  Support 

RDEC /  Contractor  Technical  Support  is  the  technical  support 
obtained  from  external  sources  to  help  develop  system  requirements,  to 
help  develop  contract  statements  of  work,  to  evaluate  contractor 
performance,  to  evaluate  technical  suitability  of  specifications  and 
designs,  to  facilitate  transfer  of  new  technologies  to  help  the  customer  be 
a  smart  buyer.  This  technical  support  is  independent  of  the  prime 
contractor.  Technical  support  may  be  obtained  from  an  agency  of  a 
partner  nations,  from  a  contracted  source,  or  a  combination  of  these 
sources.  This  support  provides  an  extension  of  the  program 
management  activity.  The  TMO  framework  includes  technical  support 
because  technical  support  plays  a  large  role  in  the  execution  and 
oversight  of  U.S.  MDAPs,  and  it  is  important  to  understand  the 
uniqueness  of  technical  support  for  international  MDAPs. 

3.  Effective  Management  of  Technical  Requirements 

Effective  management  of  technical  requirements  is  critical  to  all 
acquisition  programs.  For  a  domestic  U.S.  MDAP,  program  requirements 
begin  with  the  User’s  ORD.  Typically,  a  U.S.  Program  Management  Office 
(PMO)  will  translate  the  ORD  into  a  contract  technical  requirements 
document  that  becomes  part  of  a  development  contract.  For 
international  MDAPs,  the  process  for  management  of  top  level 
requirements  will  vary  from  program  to  program. 
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4.  Management  of  Technical  Risk 

Management  of  teehnieal  risk  is  eritieal  to  all  aequisition  programs. 
In  simple  terms,  every  opportunity  requires  identifying  anything  that  ean 
eause  a  program  to  fail  and  then  doing  something  about  it.  In  praetiee, 
risk  management  may  involve  seleetion  of  eontraetors  with  proven  traek 
reeords  for  sueeessfully  developing  systems,  identifieation  of  teehnology 
risks,  establishment  of  Teehnieal  Performanee  Measures  (TPMs)  for 
monitoring  teehnieal  risk,  identifieation  of  proeess  risks,  establishment 
of  proeess  metries,  and  monitoring  of  risk  throughout  the  program.  The 
manner  that  any  program  manages  teehnieal  risk  will  have  a  large 
impaet  on  the  sueeess  of  a  program  that  involves  signifieant  teehnieal 
risk. 


5.  Technical  Monitoring  Capability 

The  teehnieal  monitoring  eapability  of  a  program  offiee  will  impaet 
the  ability  to  effeetively  manage  a  program.  It  has  been  stated  for  eontrol 
systems  that  you  eannot  eontrol  what  you  eannot  measure.  A  “good” 
eontraetor  will  have  internal  eontrols  and  be  able  to  manage  effeetively. 
however,  as  long  as  people  have  self  interest,  we  should  not  assume  the 
eontraetor  will  look  out  after  Government/ International  Partner 
interests.  Some  level  of  teehnieal  monitoring  is  neeessary. 

6.  Direct  Technical  Contribution 

There  are  times  in  a  program  when  a  Government/ IPO  person 
must  make  a  direet  teehnieal  eontribution.  This  may  oeeur  in  a  variety 
of  eireumstanees.  If  a  requirement  eannot  be  met,  a  Government/ IPO 
engineer  may  need  to  help  identify  an  aehievable  and  meaningful 
requirement.  The  Government/ IPO  engineer  may  be  aware  of 
teehnologies  that  may  provide  solutions  to  intraetable  problems.  If  the 
system  must  interfaee  with  other  systems,  the  Government/ IPO  engineer 
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may  have  to  help  work  out  a  mutually  agreeable  ehange  to  an  existing 
interfaee.  In  some  eases  the  Government/ IPO  engineers  may  be  in  a 
better  position  than  the  eontraetor  to  identify  existing  solutions  that  ean 
be  either  direetly  ineorporated  into  the  MDAP  or  modified  and  ineluded, 
leading  to  eost  savings.  Government/ IPO  review  of  proposed  designs 
may  identify  flaws  based  on  experienee  with  other  systems. 

7.  Control  of  and  Access  to  Technical  Data 

Effective  control  of  and  access  to  technical  data  by 
contractor/ IPO/  Government  personnel  is  important  to  the  success  of 
the  program.  Without  configuration  control,  any  MDAP  involving 
millions  of  components  and  millions  of  software  lines  of  code  is  a 
disaster.  For  the  purpose  of  configuration  management,  a  computer 
based  technical  data  repository  may  be  used  with  clearly  defined  access 
and  change  authorizations.  A  sound  configuration  management  plan  is 
essential. 

Another  aspect  related  to  control  and  access  to  technical  data  has 
to  do  with  company  or  Government  ownership  of  data.  A  company  may 
consider  certain  data  to  be  competition  sensitive  and  may  not  want  to 
share  that  data.  Governments  may  consider  certain  data  to  be  militarily 
sensitive,  and  may  not  want  to  share  the  information  with  other 
countries  for  fear  of  losing  tactical  or  strategic  military  advantage. 

Different  approaches  can  be  taken  to  sharing  country  or  company 
proprietary  data.  One  approach  is  to  allow  open  access  to  all  information 
by  all  program  personnel  (assuming  a  reasonable  need  to  know).  If 
multiple  companies  are  involved,  this  might  not  be  palatable  because  of 
company  desires  to  protect  proprietary  information.  Sometimes  the  U.S. 
is  reluctant  to  share  all  technical  details  with  its  partners  in  areas  where 
the  U.S.  has  a  perceived  significant  technological  lead.  Contractors  are 
often  reluctant  to  share  information  with  the  Government /IPO,  perhaps 
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due  to  fear  of  Government  interferenee.  How  effeetive  an  international 
MDAP  is  at  sharing  neeessary  information  ean  have  a  large  influenee  on 
the  sueeess  of  the  program. 

8.  User  Participation 

User  partieipation  may  be  desired  during  the  early  design  stages  of 
an  MDAP,  partieularly  for  defining  details  of  Human  System  Integration 
(HSI)  interfaees.  The  system  must  be  designed  to  meet  the  extremes  of 
human  weight,  size,  shape,  strength  and  intelligenee  that  is  required. 

HSI  studies  are  often  useful  to  help  determine  optimal  switeh 
eonfigurations,  responses  to  audible  alert  signals  and  eomputer  display 
appearanee. 

9.  Cost  Share  and  Work  Share 

In  addition  to  affeeting  prime  eontraetor  work  plans  and  alloeation 
of  resourees,  eost  share  and  work  share  may  have  an  effeet  on  TMO. 

This  may  affeet  aeeess / utilization  of  independent  Hardware  in  the  Loop 
and  other  simulation  faeilities,  interoperability  faeilities,  and  test 
faeilities.  This  may  also  affeet  aeeess  to  teehnieal  support. 

10.  Preparation  of  Contract  Statements  of  Work  (SOW) 

Preparation  of  Contraet  Statements  of  Work  (SOW)  is  a  primary 
responsibility  of  the  teehnieal  management  aetivity  within  many  program 
management  offiees.  The  resulting  SOW  beeomes  the  effeetive  Bible  for 
all  teehnieal  work  performed  under  the  eontraet  by  the  eontraetor  and  for 
TMO  interaetions  with  the  eontraetor.  Required  deliverables  and 
aetivities  will  affeet  the  nature  of  TMO  for  the  duration  of  the  eontraet. 


38 


D.  PROGRAM  FEEDBACK  AND  INPUTS  AFFECTING  TMO 

1.  International  Executive  Control 

International  executive  control  is  accomplished  by  an  international 
board  of  directors  consisting  of  senior  members  of  the  acquisition 
community  of  each  nation.  Collectively  the  group  will  be  chartered  to 
oversee  the  IPO  and  make  executive  decisions  that  are  outside  of  the 
authority  of  the  IPO.  Although  not  fully  accurate,  this  international 
executive  control  activity  has  been  likened  to  the  DOD,  for  an 
international  program. 

2.  TMO  Funding 

For  the  purpose  of  this  paper,  TMO  funding  is  the  funding  for  the 
IPO  engineering  staff,  the  funding  for  IPO  technical  support,  and  the 
funding  applied  independently  by  each  partner  nation  for  engineering 
staff  and  for  technical  support. 

3.  National  Interaction 

National  interaction  is  the  interactions  between  the  IPO  and  the 
national  authorities  and  bureaucracies.  Although  figure  5  suggests  an 
isolation  of  the  IPO  from  international  processes,  coordination  must 
occur  between  the  IPO  and  the  host  nations.  Requirements  must  be 
agreed  upon.  Changes  must  be  coordinated.  Test  facilities  must  be 
arranged.  Contract  SOWs  must  be  developed  and  agreed  upon.  The 
degree  to  which  each  nation  becomes  involved  in  these  activities  external 
to  the  IPO  will  be  determined  by  each  nation,  led  by  the  respective 
steering  committee  member. 

4.  U.S.  Acquisition  Review  Prior  to  the  Next  Program  Phase 

For  continuation  of  an  MDAP,  there  must  be  a  U.S.  Acquisition 
Review  Prior  to  the  Next  Program  Phase.  This  applies  to  international 
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MDAPs  as  well  as  domestic  MDAPs.  What  is  different  between  an 
international  MDAP  and  a  domestic  MDAP  is  the  tailoring  of  DOD  5000 
requirements.  The  mandates  of  an  international  MDAP  are  determined 
by  the  international  Memorandum  of  Understanding  (MOU),  which  is 
developed  considering  the  national  laws  and  regulations  of  all  partner 
nations.  DOD  5000  does  not  necessarily  apply!  However,  for  U.S. 
participation  in  an  international  MDAP  to  continue,  a  decision  must  be 
made  to  continue.  DOD  5000  is  intended  to  be  tailored,  however,  the 
U.S.  DOD  acquisition  community  does  not  have  a  lot  of  experience  with 
international  programs. 
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IV.  TMO  FRAMEWORK  APPLIED 


A.  HAWK 

Information  about  the  HAWK  program  has  been  primarily  obtained 
from  an  interview  with  Mr.  John  Robins  who  was  the  eivilian  Deputy 
Program  Manager  for  Hawk.  Extensive  exeerpts  have  been  made  from 
this  interview.  While  this  may  not  be  normal  praetiee,  Mr.  Robins  words 
speak  for  themselves. 


1 .  Overview 

HAWK  is  an  Air  Defense  System  first  developed  by  the  U.S.  Army 
in  the  1950s 
and  then  sold  to 
and  or  produeed 
by  more  than 
22  eountries 
worldwide. 

Figure  13 
depiets  HAWK 
missiles  on  a 
HAWK 
launeher. 


Although  the 
U.S.  Military  no 
longer  uses 
HAWK,  the 
system  is  still  in 
use  by  other 

eountries.  Key  eomponents  of  HAWK  are  eontinuous  wave  and  pulse 
aequisition  radars  for  low  to  medium  range  target  aequisition;  a 


Figure  13:  HAWK  Missiles  (from 
http:  /  /www.raytheon.com/es/esproducts/ dssh 
awk  /  dsshawk.  htm) 
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command  post  for  Command  and  Control  (C2)  functions, 
communications  and  data  processing;  the  HAWK  missile;  and  the 
launeher.  The  HAWK  system  has  been  involved  in  eonfliets  during  the 
last  several  deeades  ineluding  the  Cuban  Missile  Crisis,  the  Vietnam 
War,  the  1967  and  1973  Arab-Israeli  wars  and  the  Persian  Gulf  war. 
Threat  targets  inelude  fixed  wing  aireraft,  rotary  wing  aireraft,  eruise 
missiles  and  short  range  ballistie  missiles 

(http:  /  /  www.raytheon.eom/es/esproduets/dsshawk/ dsshawk.htm). 

2.  Application  of  the  TMO  Framework 
a.  TMO  Considerations 

Table  7  eaptures  the  TMO  framework  elements  for  HAWK. 


Table  7:  HAl 

iVK  TMO  Considerations  Framework  Elements 

TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

HAWK  was  developed  by  the  U.S.  Army  and  was  later  sold  to  other 
countries  as  a  completed  product  or  as  a  data  package  that  would 
enable  foreign  production.  U.S.  project  office  personnel  coordinated 
with  foreign  counterparts  for  sales  and  setting  up  production  lines, 
The  HAWK  PM  office  was  staffed  with  U.S.  personnel. 

2.  RDEC/ 
Contractor 
Technical 
Support 

HAWK  technical  support  included  in-house  technical  support  from 
the  Government  Program  Management  Office  (PMO),  from  the  Army 
Missile  Command  (MICOM)  RDEC  and  from  expert  technical 
consultants. 

3. 

Management 
of  Technical 
Requirements 

Stable  requirements  and  design  were  important  for  the  HAWK 
program,  especially  after  the  beginning  of  international  co¬ 
production  and  international  sales.  An  effort  was  made  to  minimize 
change  of  the  international  technical  data  package  that  was  a 
directly  result  of  difficulties  managing  change  in  an  international 
environment. 
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Table  7:  HA^ 

iVK  TMO  Considerations  Framework  Elements 

TMO 

Consideration 

Interview/ Assessment 

4. 

Management 
of  Technical 
Risk 

Management  of  Technical  Risk  for  HAWK  was  affected  by 
international  program  participation  in  that  when  technical  problems 
were  discovered,  there  was  a  danger  of  international  finger  pointing 
to  assign  blame  for  any  particular  problem.  When  problems  were 
discovered,  the  U.S.  State  Department  might  get  involved  and  the 
process  of  identifying  the  problem  and  subsequently  solving  the 
problem  might  become  clouded  in  international  politics. 

Management  of  technical  risk  was  more  difficult  because  of  the 
additional  external  scrutiny  resulting  from  the  international 
participation. 

5.  Technical 

Monitoring 

Capability 

Technical  Monitoring  Capability  for  HAWK  was  not  overtly 
influenced  by  international  participation,  because  the  U.S.  HAWK 
development  activity  did  not  involve  international  participation.  The 
TMO  activity  within  the  U.S.  HAWK  PMO  monitored  contractor 
performance  independent  of  international  considerations.  Use  was 
made  of  internal  HAWK  PMO  technical  support,  the  RDEC,  and  if 
warranted,  independent  expert  technical  consultants. 

6.  Direct 
Technical 
Contribution 

During  production,  a  conscious  effort  was  made  to  minimize  change 
to  the  international  technical  data  package  because  of  the  concern 
for  upsetting  a  fragile  relationship.  This  had  an  effect  on  any 
contributions  made  by  TMO  personnel.  However,  during 
development,  the  direct  technical  contributions  of  TMO  personnel 
were  not  influenced  by  international  considerations.  The  goals  of 
TMO  were  as  follows: 

(1)  Ensure  users  requirements  are  clearly  stated  in  a  system  spec 

(2)  Monitor  the  performance  of  the  contractor  development  effort 
with  intermediate  technical  milestones 

(3)  Do  root  cause  analysis  when  a  problem  is  discovered  Don’t  let 
the  contractor  just  keep  testing  and  trying  to  fix  the  problem  until 
the  problem  is  fully  understood. 
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Table  7:  HAl 

iVK  TMO  Considerations  Framework  Elements 

TMO 

Consideration 

Interview/ Assessment 

7.  Control  of 
and  Access  to 
Technical  Data 

Control  of  and  Access  to  Technical  Data  was  not  an  issue  for  HAWK 
development.  Export  decisions  were  made  regarding  the  technical 
data  package  for  independent  international  production  and  export 
of  the  completed  HAWK  systems.  Export  decisions  also  had  to  be 
made  regarding  individual  HAWK  upgrades.  However,  because  the 
development  activity  was  under  the  sole  control  of  the  U.S.  Army, 
Foreign  Release  of  information  from  other  systems  or  involving 
advanced  research  or  detailed  algorithms  was  not  required.  When 
upgrades  were  made  as  a  result  of  sensitive  intelligence  information, 
the  system  upgrade  was  developed,  perhaps  a  vulnerability  was 
eliminated.  A  system  upgrade  was  published,  and  customers  could 
buy  them,  however,  nothing  was  published  identifying  the  technical 
details  of  the  change,  and  in  the  case  of  vulnerability  related 
changes,  nothing  was  published  describing  the  vulnerability  that 
was  being  addressed.  Thus,  the  problem  of  obtaining  approvals  to 
release  information  was  minimized  by  limiting  the  information 
released  to  the  minimum  necessary  to  use  the  system  or  to 
manufacture  the  system. 

8.  User 
Participation 

User  Participation  for  HAWK  development  involved  the  U.S.  Army 
user,  and  there  are  no  international  considerations  for  HAWK  user 
participation. 

9.  Cost  Share 
and  Work 

Share 

Cost  Share  and  Work  Share  did  not  become  an  issue  for  HAWK 
development  because  HAWK  was  developed  by  and  for  the  U.S. 

Army.  When  upgrades  were  developed  after  international 
production  and  sales  had  begun,  HAWK  owners  were  given 
opportunity  to  purchase  the  upgrades  and  to  provide  funding  to 
create  the  upgrade  (as  in  the  MTBF  upgrade  of  the  radar  described 
earlier). 

10. 

Preparation  of 
Contract 

SOWS 

Preparation  of  Contract  Statements  of  Work  (SOW)  did  not  involve 
international  negotiations  or  special  international  considerations. 

b.  TMO  Program  Feedback  Considerations 

Table  8  captures  the  TMO  Program  Feedback  framework 
elements  for  HAWK. 
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Table  8:  HAWK  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1 .  International 
Exeeutive 

Control 

International  Executive  Control  did  not  apply  to  HAWK. 

2.  TMO 

Funding 

There  were  no  international  considerations  for  HAWK  development 
TMO  funding.  The  HAWK  PMO  was  managed  by  U.S.  personnel  and 
TMO  personnel  were  U.S.  people. 

3.  National 
Interaetion 

National  Interaction  for  HAWK  was  limited  to  coordination  related 
to  purchasing  of  complete  HAWK  missile  systems,  the  technical  data 
package  and/or  individual  system  upgrades.  There  were  no  joint 
decision  processes  that  were  dependent  on  agreement  of  all  parties 
to  move  forward  with  the  program.  There  was  pressure  to  minimize 
change  to  the  HAWK  technical  data  package,  which  minimized  even 
further  the  international  coordination  required. 

4.  US 

Aequisition 
Review  prior  to 
next  phase 

U.S.  acquisition  review  for  HAWK  was  consistent  with  other  U.S. 
managed  programs.  This  was  possible  because  the  HAWK  program 
was  controlled  by  a  U.S.  PMO  and  the  HAWK  program  was  U.S. 
controlled. 

3.  Elaboration 

a.  Example:  The  Value  Of  HAWK  Technical  Support 

When  serious  teehnieal  problems  arise  in  a  program,  often 

the  eontraetor,  TMO  personnel  and  perhaps  even  RDEC  personnel  are 

too  elose  to  the  problem  or  laek  the  expertise  to  establish  the  root  eause 

of  the  problem.  Sometimes  it  is  neeessary  to  bring  in  outside 

eonsultants.  At  key  points  in  development  and  during  produetion  the 

eost  may  be  easily  justified.  Making  the  right  teehnieal  deeision  may 

have  a  major  infiuenee  on  eapability  and  eost  through  the  life  of  the 

fielded  system  and  a  delay  in  produetion  will  be  eostly.  An  experienee 

highlighting  the  importanee  of  outside  teehnieal  eonsultants  and  good 

TMO  analysis  involved  HAWK  missiles  that  exploded  prematurely  during 

test  firings  due  to  faulty  roeket  motors. 

Sueeessful  HAWK  produetion  had  been  ongoing  for  several 
years.  HAWK  was  at  maximum  produetion.  There  were  22 
eountries  involved  in  produetion  or  as  buyers.  Japan  was 
eo-produeing  and  NATO  had  a  big  eo-produetion  group. 
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They  were  in  produetion  on  their  own.  Others  were  buying 
from  us.  Lord  knows,  Iran  had  more  HAWKs  than  we  did! 
Now,  when  we  diseuss  HAWK,  we  are  talking  about  more 
than  just  the  system.  There  are  training  faeilities  and  test 
faeilities,  and  the  who  thing.  At  one  time  60%  of  the  people 
at  Redstone  worked  in  some  way  on  the  HAWK  program. 
Aerojet  had  eome  up  with  a  HAWK  motor  whieh  is  real 
elever.  It  used  a  ease  bonded  propellant  that  is  east  in  one 
pieee,  and  it  worked!  All  around  the  world  we  were 
produetion  thousands  per  month.  During  lot  qualifieation 
testing  at  Aerojet,  one  blew  up.  It  was  determined  that  the 
problem  was  related  to  de-bonding  of  the  propellant.  The 
eontraetor  wanted  to  just  serub  the  lot  and  produee  another 
without  further  analysis,  but  we  said  no,  let’s  look  at  another 
lot.  ...  We  had  the  same  problem  with  the  other  lot.  We 
immediately  froze  the  lots  we  eonsidered  suspeet. 

Now,  you’ve  got  22  eountries  involved,  ineluding  the  NATO 
eonsortium  and  they  are  saying,  ‘It’s  your  fault,  you  have 
ehanged  the  teehnieal  data  paekage.’  We  are  talking  about 
lots  of  motors.  We  had  the  same  problem  of  de-bonding!  We 
then  froze  the  lots  we  thought  were  suspeet.  Now  you’ve  got 
22  eountries  ineluding  the  NATO  eonsortium.  and  they  are 
saying,  ...  ‘It’s  your  fault.  We  are  using  your  teehnieal  data 
paekage  and  You’ve  ehanged  the  data  paekage.’  Then,  next 
thing  you  know,  their  missiles  start  blowing  up.  So  it  was 
our  fault.  We  are  talking  about  lots  of  motors,  lots  of  people, 
lots  of  nations.  You  get  the  state  department  involved. 

This  is  a  little  problem,  if  you  only  had  the  U.S.  involved. 
You’d  get  in  and  work  the  problem.  It’s  a  good  problem  to 
solve.  But  when  you  get  the  state  dept,  involved,  you  don’t 
have  time  to  swat  the  knats  that  are  going  around.  Well,  you 
know,  we  get  baek  to  basies  here.  There  is  no  sense  in 
haeking  on  this  thing  until  we  find  out  what  the  problem  is. 
Of  eourse  Aerojet  already  had  a  fix.  We  said,  no,  were  going 
to  introduee  you  to  a  subjeet  ealled  root  eause  analysis.  You 
may  say  ‘that’s  ridieulous,  .  I  ean  take  you  the  Raytheon, 
Aerojet,  Lineoln,  Vought,  just  about  every  eontraetor  I  have 
dealt  with  and  they  are  all  the  same.  I  mean,  it’s  their 
nature,  [they  want  to  jump  to  the  solution  before 
understanding  the  problem.]  An5rway,  we  put  a  root  eause 
team  at  aerojet.  And  I  said,  one  of  the  people  we  want  to  find 
is  a  ehemieal  engineer  who  has  worked  there  for  a  while,  but 
who  is  retired.  I  talked  to  the  president  of  Aerojet,  and  he 
agreed  to  help.  You  know  the  Navy  used  this  motor  too.  I 

46 


said,  you  don’t  know  where  the  end  of  this  thing  is.’ 
Fortunately  in  HAWK  we  had  the  produetion  lots  bounded 
that  we  thought  were  affeeted.  Well,  we  found  this  fellow 
and  we  put  him  on  our  root  eause  team.  We  took  our  best 
engineers  and  put  them  on  the  team.  The  review  team  eame 
in  as  often  as  needed  to  say  how  they  are  doing  and  their 
status  and  what  they  new  and  presented  the  information. 
This  older  fellow  says.  Where  did  you  get  that  data?’  We  got 
it  from  so  and  so  down  in  Aerojet.’  ‘  Don’t  believe  him,  he’s 
not  trustworthy.’  It  turned  out,  the  souree  of  the  data  was 
giving  bad  data!  And  we  went  and  found  out  that  this  guy 
had  and  ehanged  a  proeess.  ...  Now  he  went  in  and 
ehanged  the  proeess  for  bonding,  and  made  that  sueker  de¬ 
bond.  His  proeedure  wasn’t’  written  up.  He  just  went  on  the 
line  and  ehanged  it.  It  was  legal,  but  not  doeumented.  He 
never  eheeked  it  out,  but  he  ehanged  the  proeess.  We  found 
that  out  and  we  made  a  motor  with  that  proeess  and  it  blew 
up.  We  made  one  with  the  original  proeess  and  it  didn’t  blow 
up.  The  original  problem  was  solved  (June  21,  2001 
Interview  with  John  Robins)  . 


b.  Example:  International  Interaction 

There  were  other  problems  with  HAWK  missiles  blowing  up. 
Overseas,  the  international  eo-produetion  teams  needed  help  identifying 
their  problems.  Additional  international  eonsiderations  for  use  of 
teehnieal  eonsultants  emerged.  As  the  example  eontinues,  it  beeomes 
elear  that  for  programs  involving  international  partieipation,  it  is 
important  to  respeet  national  pride  and  the  uniqueness  of  different 
eultures. 


. . .  and  so  we  then  sent  the  team  of  people  oversees  to  find 
out  why  they  were  having  problems.  We  sent  our 
eonsultants  over  there,  with  an  explosives  expert,  one  who 
gets  involved  when  eotton  gins  blow  up  and  things  like  that. 
He  went  where  the  Freneh  were  making  the  motor.  So  we 
went  in  and  said  well  find  out  what’s  going  on.  Understand 
that  this  motor  needs  to  be  made  in  an  environmentally 
eontrolled  faeility.  This  whole  motor  de-bonding  problem  is 
related  to  moisture.  And  you  know  how  sensitive  the  Freneh 
are  and  the  kind  of  eourtesy  and  diplomaey  you  need  in 
dealing  with  these  people.  Well,  eonsultants  don’t  worry 
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about  these  things.  You  ask  them  to  see  what  the  problem 
is,  ...  I’ll  never  forget,  we  almost  had  a  war  over  there.  This 
group  went  in  to  eheek  this  faeility  that  is  supposed  to  be 
environmentally  eontrolled,  and  they  look,  and,  ...  in  the  exit 
interview,  the  on  site  people  and  the  managers  are  informed 
about  the  findings.  The  eonsultant  said,  ‘how  in  hell  ean 
you  say  this  is  environmentally  eontrolled,  I  saw  a  rat  eome 
through  that  door!’  There  were  gales  of  silenee  from  Europe. 
We  went  for  3  years  and  never  made  a  ehange  in  the 
teehnieal  data  paekage  beeause  of  that.  Beeause  if  there 
was  any  ehange  in  the  teehnieal  data  paekage  they  would 
say  ‘it  is  your  problem’  (June  21,  2001  interview  with  John 
Robins). 


c.  Example:  Direct  Technical  Contribution 

An  example  of  a  direet  teehnieal  eontribution  on  the  HAWK 

program  from  TMO  personnel  is  deseribed  below: 

In  the  HAWK  program,  they  had  a  radar.  I  was  new  on  the 
program.  I  wanted  to  know,  what  is  the  worst  Mean  Time 
Between  Failure  (MTBF)  part.  What  is  the  highest  repair 
part  eost.  In  HAWK  the  radar  to  be  operational  24  hr  day 
360  days  per  year,  with  a  27  hour  MTB!  Those  people  [the 
soldiers]  were  in  trouble,  struggling  to  make  this  thing  keep 
working.  We  eonsidered  initiating  a  value  program.  The 
HAWK  radar  is  a  wonderful  pieee  of  equipment,  with  tubes, 
that  was  impossible  to  maintain.  We  spent  as  mueh 
international  money  as  we  eould  get  in  an  effort  to  improve 
the  MTBF  to  150  Hours.  We  put  up  both  international 
money  and  US  money  to  develop  the  improvement.  One  of 
the  quantified  Mile  Stones  we  established  was  ‘You  will  make 
3  of  these.  You  will  take  parts  of  A,  B  and  C  and  exehange 
the  parts  and  make  them  work.’  Raytheon  was  able  to  make 
the  first  system  work  as  required  with  some  speeial  effort. 

They  were  able  to  make  the  seeond  system  work  too. 

However,  it  beeame  apparent  that  fundamental  diffieulties 
were  being  eneountered  that  were  not  being  solved.  It  was 
not  possible  to  interehange  the  parts  of  the  different  systems 
and  expeet  them  to  operate.  We  sent  two  of  Dr.  MeCorkle’s 
young  radar  engineers  from  the  MICOM  RDEC,  Mike 
MeFahee  and  George  O’Reilly,  to  monitor  the  development 
aetivity.  They  were  young,  but  they  were  good.  I  knew  there 
would  be  teehnieal  problems  [improving  the  MTBF],  I  just 
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didn’t  know  where  they  would  be.  We  had  high  power  tubes 
near  low  power  sensitive  eleetronies.  I  said,  ‘I  smell 
something  bad  going  on  down  there,  will  you  go  and  see?’ 
They  eame  baek  and  said,  with  a  lot  of  tweaking  they  got  one 
to  work,  then  with  even  more  tweaking  they  got  the  seeond 
unit  to  work.  They  said  There  is  not  a  snowballs  ehanee  in 
hades  they  will  be  able  to  swap  those  parts  and  make  them 
work.’  But  the  eontraetor  wouldn’t  admit  it,  beeause  we’re 
talking  a  lot  of  money.  The  eontraetor  did  not  want  to  hear 
about  it.  I  told  them,  talk  to  my  guys,  and  if  they  are  wrong, 
eonvinee  them.  Listen  to  them  too.  ...  Next  thing  I  know, 
Raytheon  eame  and  tried  to  eonvinee  me.  But  it  was  just 
handling.  I  told  them,  you’ve  got  a  quantified  milestone  that 
requires  you  to  be  able  to  interehange  the  parts.’  Well  they 
went  to  the  MICOM  eommanding  general,  and  to  the  Offiee  of 
the  Seeretary  of  Defense  (OSD),  ...  but  I  had  my  experts  that 
I  believed.  The  Raytheon  guys  look  down  on  you  but  they 
don’t  help.  This  was  around  Christmas  time.  I  issued  a  stop 
work  order.  Raytheon  had  never  been  subjeet  to  a  stop  work 
order.  They  said,  Tou  ean’t  do  that.’  I  said,  talk  to  the 
eontraeting  offieer.  YouVe  got  90  days.  They  said.  What 
ean  we  do?’  Well,  they  ealled  in  Peter  Swerling,  who  invented 
Swerling  1  and  Swerling  2  for  radars,  a  famous  radar  person. 
But  the  best  were  MeCorkle’s  guys.  The  faet  is,  they  even 
have  their  own  eompany  now  ealled  Phase  4.  They  found  the 
problem  and  suggested  how  Raytheon  eould  fix  it.  Raytheon 
had  90  days  to  fix  it  and  they  did.  We  were  elose  to 
terminating.  But  we  got  a  radar  that  had  175  hr  MTBF  (21 
June,  2001  Interview  with  John  Robins). 


B.  ROLAND 

Information  about  the  ROLAND  program  has  been  primarily 
obtained  from  an  interview  with  Mr.  John  Robins  who  was  the  eivilian 
Program  Manager  for  ROLAND.  Extensive  exeerpts  have  been  made  from 
this  interview.  While  this  may  not  be  normal  praetiee,  Mr.  Robins  words 
speak  for  themselves. 


49 


1 .  Overview 

Figure  14  depicts 
the  firing  of  a  ROLAND 
missile.  The  US 
ROLAND  missile  is  a 
short  range,  low- 
altitude,  all-weather. 
Army  air  defense 
artillery  surface-to-air 
missile  system  which  is 
based  upon  the  Franco- 
German  ROLAND  III 
missile  system. 


Figure  14:  ROLAND  Missile  Firing  (from 
http:  /  /www.redstone. army.mil/history/ 
roland  /  summary .  html) 


2.  Application 
of  the  TMO  Framework 

a.  TMO  Considerations 

Table  9  captures  the  TMO  framework  elements  for  ROLAND. 


Table  9:  ROLAND  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

The  U.S.  ROLAND  program  was  a  production  program  that  was 
based  on  a  European  system,  ROLAND  III.  ROLAND  III  was 
developed  by  a  consortium  of  European  countries.  Compared  to  the 
HAWK  program,  ROLAND  was  a  reverse  situation.  At  the  time  the 
U.S.  became  involved,  the  European  ROLAND  office  included  six 
European  countries  headed  by  a  French  general. 
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Table  9:  ROLAND  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

2.  RDEC/ 
Contractor 
Technical 
Support 

RDEC/ Contractor  Technical  Support  included  in-house  technical 
support  from  the  Government  Program  Management  Office  (PMO), 
from  the  Army  Missile  Command  (MICOM)  RDEC  and  from  expert 
technical  consultants. 

3. 

Management 
of  Technical 
Requirements 

Hughes  and  Boeing,  had  to  obtain  the  technical  data  package  for 
the  ROLAND  air  defense  system  and  then  integrate  ROLAND  with 

U.S.  Honest  John  Trucks,  which  did  not  initially  satisfy  the 
requirements  for  ROLAND. 

4. 

Management 
of  Technical 

Risk 

Management  of  Technical  Risk  for  the  U.S.  ROLAND  program  was 
focused  on  the  implementation  by  U.S.  contractors  of  technology 
developed  in  Europe.  However,  some  technical  aspects  of  the 
system  had  to  be  improved  in  order  to  improve  reliability  and 
simplify  the  use  of  the  system.  One  of  the  risks  had  to  do  with  the 
reliability  and  calibration  of  the  radar.  This  risk  was  uncovered 
during  user  testing. 

5.  Technical 

Monitoring 

Capability 

Technical  Monitoring  Capability  for  ROLAND  was  not  overtly 
influenced  by  international  participation,  because  the  U.S.  ROLAND 
development  activity  consisted  of  U.S.  contractors  producing  an 
existing  system  from  a  technical  data  package  supplied  by  the 
European  consortium.  The  TMO  activity  within  the  U.S.  ROLAND 
PMO  monitored  contractor  performance  independent  of 
international  considerations.  Use  was  made  of  technical  support 
within  the  HAWK  PMO  office,  the  MICOM  RDEC,  and  when 
warranted,  independent  expert  technical  consultants. 

6.  Direct 
Technical 
Contribution 

There  was  little  opportunity  for  direct  technical  contribution  by  U.S 
ROLAND  TMO  personnel  due  to  the  nature  of  the  program. 

However,  as  with  TMO  for  all  U.S.  programs,  the  focus  and  concern 
needs  to  be  for  the  system  to  satisfy  the  User’s  needs.  Two  U.S. 
ROLAND  activities  can  be  called  direct  technical  contributions:  The 
safe  and  effective  integration  of  the  Honest  John  trucks  into 

ROLAND.  The  upgrade  of  the  ROLAND  radar  to  simplify  operations 
and  to  minimize  calibration. 

7.  Control  of 
and  Access  to 
Technical  Data 

Control  of  and  Access  to  Technical  Data  was  not  an  issue  for 
ROLAND.  Transfer  of  the  technical  data  package  from  the 

European  developers  was  arranged  by  Hughes  Corporation  and 
Boeing  Corporation. 

8.  User 
Participation 

User  participation  for  the  U.S.  ROLAND  production  was  limited  to 
test.  The  interests  of  the  user  were  of  paramount  concern  for  U.S. 
ROLAND  TMO,  and  resulted  in  a  truck  improvement  and  a  radar 
improvement. 

9.  Cost  Share 
and  Work 

Share 

Cost  Share  and  Work  Share  did  not  directly  apply  to  the  U.S. 

ROLAND  program  and  had  no  bearing  on  TMO. 
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Table  9:  ROLAND  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

10. 

Preparation  of 
Contract 

SOWS 

Preparation  of  Contract  Statements  of  Work  (SOW)  was  a  critical 
activity  for  U.S.  ROLAND  TMO,  however,  due  to  the  existing 
technical  data  package,  the  SOWs  primarily  addressed  production. 
There  were  no  international  considerations  for  development  of  these 
statements  of  work. 

b.  TMO  Program  Feedback  Considerations 

Table  10  captures  the  TMO  Program  Feedback  elements  for 
ROLAND. 


Table  10:  ROLAND  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1. 

International 

Executive 

Control 

International  Executive  Control  did  not  apply  to  the  U.S.  ROLAND 
program. 

2.  TMO 

Funding 

TMO  Funding  was  provided  by  the  U.S.  and  there  were  no  direct 
international  considerations.  ROLAND  development  was  essentially 
complete  prior  to  the  U.S.  becoming  involved  and  did  reduce  cost 
risk,  although,  there  was  an  effort  to  either  eliminate  the  program  or 
to  reduce  the  cost  of  the  U.S.  ROLAND  program  by  one  half.  The 
ROLAND  international  agreements  may  have  motivated  congress  to 
insist  that  funding  be  maintained. 

3.  National 
Interaction 

Following  program  initiation,  there  was  no  significant  national 
interaction  between  U.S.  Government  personnel  and  European 
personnel.  The  burden  for  international  coordination  fell  on  Hughes 
and  Boeing  personnel,  at  the  technical  level  and  with  European 
contractor  counterparts.  Liaison  was  maintained  with  the  European 
ROLAND  program  office  by  the  U.S.  ROLAND  program  office, 
however,  this  had  no  significant  impact  on  TMO. 

4.  US 
Acquisition 
Review  prior  to 
next  phase 

U.S.  Acquisition  Review  Prior  to  the  Next  Program  Phase.  The  U.S. 
ROLAND  Program  went  directly  to  production  and  there  was  no 
follow-on  acquisition  phase  and  thus  no  acquisition  review  prior  to 
the  next  program  phase. 
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3.  Elaboration 


a.  Discussion:  ROLAND  International  Organization 

The  U.S.  ROLAND  program  was  a  production  program  that 

was  based  on  a  European  system,  ROLAND  III.  ROLAND  III  was 

developed  by  a  consortium  of  European  countries.  Compared  to  the 

HAWK  program,  ROLAND  was  a  reverse  situation.  At  the  time  the  U.S. 

became  involved,  the  European  ROLAND  office  included  six  European 

countries  headed  by  a  French  general  who  dressed  in  Civilian  Clothes. 

ROLAND  was  supplied  by  the  6  nation  European  consortium 
and  the  U.S.  hired  Boeing  and  Hughes.  They  had  to  make 
the  arrangements  for  the  data  package  to  come  to  them.  The 
reason  for  U.S.  involvement  in  ROLAND  was  cooperation  in 
international  sales.  They  developed  it  and  we  produced  it 
over  here.  In  the  case  of  HAWK,  it  was  developed  over  here 
and  produced  over  there.  For  ROLAND,  we  didn’t  buy 
systems  from  them,  we  just  took  the  ROLAND  data  package, 
cobbled  it  up  and  made  something  (21  June  2001  Interview 
with  John  Robins.) 

The  European  consortium  had  their  office  in  Paris,  and  we 
had  a  Liaison  officer.  The  work  environment  was  different 
from  the  work  environment  we  are  accustomed  to  in  the  U.S. 

Never  get  there  before  10:00  a.m.  ...  you  would  always  leave 
by  2:00  p.m.  Never  call  anyone  at  home,  always  leave  before 
Friday  at  noon,  always  very  formal.  French  people  are  very 
different.  ...  I  also  had  to  admire  the  people  in  the  office. 

Many  of  them  spoke  fluently  6  languages.  They  put  us  to 
shame.  They  never  argued.  They  always  listened.  They 
would  take  in  and  they  would  negotiate.  They  were  shrewd 
negotiators.  (June  21  2001  Interview  with  John  Robins). 


b.  ROLAND  Example:  Management  of  Requirements 

I  guess  the  best  I  ever  felt.  ...  I  was  one  of  the  early  civilian 
product  managers.  I  was  called  at  10:00  pm  and  was  told 
that  I  needed  to  see  the  vice  chief  of  staff  of  the  army  in 
Washington  and  tell  him  why  my  program  cost  so  much. 

And  so  I  went  out  the  next  morning,  opened  my  safe  and  got 
some  stuff  out,  got  on  the  Redstone  Rocket  and  flew  into 
Washington  and  got  in  a  taxi  and  went  into  the  Pentagon. 
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I’ll  tell  you,  those  people,  ...  when  the  viee  ehief  wants  to  see 
you,  you  go  through  layers  real  fast.  They  were  pushing  me 
into  his  offiee  and  set  me  down  in  the  hot  seat.  There  were 
all  the  generals  and  friends,  I  thought  they  were  my  friends, 
and  they  set  me  down  in  the  hot  seat  in  front  of  the  Viee 
Chief  of  Staff.  He  looked  at  me,  and  I  said,  you  asked  me  to 
eome  and  I’m  here.  The  problem  was  that  we  were  going  to 
deploy  ROLAND  with  the  New  Mexieo  National  Guard.  The 
intention  was  for  the  National  Guard  to  deploy  an5rwhere  in 
the  world  within  24  hours  and  proteet  airfields  and  so  forth. 
Looking  at  it,  it  was  real  elear  what  it  was  going  to  take  to 
keep  the  system  eertified  and  viable.  ...  He  said,  ‘Cut  your 
program  eost  in  half  and  you’ve  got  a  program.’  And  I  just 
said,  ...  ‘Sir,  if  it  is  out,  the  Army  ean’t  afford  this  program. 
I’m  your  manager,  and  I’ll  be  glad  to  eaneel  it  for  you.’ 

People  were  erawling  under  tables,  and,  ....  you  don’t  talk  to 
the  viee  ehief  of  Army  that  way.  I  said,  ‘Sir  we  don’t  want  to 
give  the  troops  junk.’  I  said,  ‘I  have  looked  at  this  program 
and  I  know  how  important  it  is  to  keep  eosts  down.  But  I 
also  know  that  if  I  ean’t  put  these,  ...  you’ve  got  these  20 
year  old  honest  john  trueks  you  got  em  mounted  on,  and  if  I 
ean’t  put  jake  brakes  on  these  trueks  and  ete  to  keep  them 
safe,  beeause  I’ve  seen  the  trueks  eome  off  the  hills  in  Korea 
with  HAWK  loads  on  them.  The  ROLAND  load  is  bigger  than 
HAWK  loads,  ...  then  we’re  going  to  lose  troops.’  I  said, 

‘We’ve  got  to  maintain  the  system  so  that  it  works.’  Also,  I 
said,  ‘We  found  out  that  if  you  don’t  train  the  troops  ,  ...’  we 
had  a  trainer  just  for  training  then  we  had  a  mini  trainer 
that  was  out,  then  we  found  out  on  a  eurve  how  many  days 
they  eould  stay  out  without  losing  their  skill,  it  was  90  days, 
and  you  eould  just  see  it,  it  was  like  driving  too  long.  I  said, 
its  true,  we  just  ean’t  deploy  this  system  if  you  ean’t  support 
it.  And  I’m  not  trying  to  say,  ...,  I’m  your  manager.  If  the 
money  is  there.  Ill  be  glad  to  deploy  it.  If  it’s  not,  you  tell  me 
and  Ill  terminate  it.  I’m  the  manager  to  run  what  you  want. 
I’m  not  just  to  put  it  out  there,  and  Ill  do  that  if  the  money  is 
there.  But  if  the  money  doesn’t  fit.  I’m  the  manager  to 
terminate  it.’  Oh,  I’ll  tell  you,  ...  I  went  home,  and  I  got  all 
the  people  together,  that  were  working  so  hard,  ...,  we  were 
just  before  deploying  it,  and  I  ealled  eivilian  personnel  and  I 
told  them,  ‘I  don’t  know  what  is  going  to  happen.’  The  funny 
thing  was  that  the  viee  ehief  then  went  over  to  the  senate 
and  said,  ‘I  have  eut  these  things  down,  ineluding  ROLAND.’ 
And  all  I  had  said  to  my  people  in  Washington  was  ‘you  send 
me  a  message  to  tell  me  to  terminate  and  Ill  terminate.’  Well 
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he  went  over  to  the  senate  and  said  he  wanted  to  terminate, 
ok  and  the  ehairman  of  the  Armed  Serviees  Committee  said, 
We  like  your  suggestions  exeept  for  one,  and  that  is  that  we 
don’t  want  you  to  termination  ROLAND.’  Now  ROLAND  is 
just  a  little  pea  in  all  that  stuff  up  there.  ...  And  so  they 
eouldn’t  send  me  a  message  to  terminate,  and  we  were  held 
in  this  little  purgatory  here.  And  so  finally  it  got  to  the  point 
where  the  eontraetor  said  we’ll  keep  working  without  any 
money.  ...  and  1  said,  no  you  won’t.  And  so  1  sent  a 
message  baek,  ....  Barring  the  faet  that  1  don’t  have  the 
money  to  eontinue  and  it’s  against  law  so  and  so  to  let  the 
eontraetor  train  troops,  support,  ete,  1  plan  to  terminate  on 
sueh  and  sueh  a  day  if  we  don’t  reeeive  the  money.’  Well, 
about  48  hours  before  the  end  of  the  time  period,  the  money 
eame.  We  deployed  ROLAND  (June  21,  2001  Interview  with 
John  Robins). 


c.  ROLAND  Example:  Management  of  Technical  Risk 

One  of  the  risks  had  to  do  with  the  reliability  and  ealibration 
of  the  radar.  This  risk  was  uneovered  during  user  testing: 

They  were  ready,  . . .  they  had  been  produeing  for  a  year 
when  1  was  sent  to  ROLAND.  1  went  in  and  they  were  about 
to  start  the  engineering  user  test.  Produetion  had  been 
going  for  a  year  and  they  hadn’t  even  done  the  test  yet.  1 
said  1  guess  we  better  start.  We  had  a  Captain  at  White 
Sands.  They  had  all  these  spare  parts,  and  he  said  how 
good  it  was  and  what  good  results  they’d  been  having.  And 
so,  1  had  to  get  a  test  manager  for  ROLAND.  He  was 
someone  1  knew  and  trusted,  and  he  was  someone  1  knew  1 
eould  work  with.  1  saw  that  was  what  was  going  to  do  it. 

Then  he  [my  test  manager]  said,  everything’s  looking  so 
good,  what  your  going  to  do  is  have  a  system  test.  Take  the 
hardware,  the  spare  parts  and  you’ve  got  the  manuals.  1  told 
the  Captain,  operate  from  the  test  plan,  and  1  want  you  to 
use  the  manual.  If  have  to  depart  from  the  manual,  don’t  do 
it  and  then  tell  me,  just  write  it  down  and  say,  this  doesn’t 
work.  If  it’s  not  in  the  manual,  these  troops  won’t  have 
someone  around  to  help  them.  Well  it  turned  out,  they  went 
out  and  the  next  thing  they  eouldn’t  do  anything.  They 
eouldn’t  hit  anything  and  eouldn’t  even  fire.  And  the 
eontraetor  was  saying,  ‘But  we  did  it,  and  hey,  you  won’t  let 
us  do  this!’  We  did  a  root  eause  analysis  to  find  out  what 
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was  going  on.  It  turns  out  the  contractor  had  been  doing 
tests  on  their  own  to  let  us  know  how  good  the  system  was. 
They  were  out  there  calibrating  the  radar  with  the  $1.5M 
spare  part,  and  they  were  calibrating  that  radar  with  an 
elaborate  machine  while  the  drone  was  in  the  air.  Then  they 
would  move  from  the  calibration  to  the  drone  and  shoot 
down  the  drone.  Well,  the  operating  procedures  said  you 
only  do  this  calibration  once  every  three  months.  This 
captain  dutifully  had  followed  procedures,  and  they  said,  ‘No 
you’ve  got  to  calibrate  it.’  The  captain  said,  ‘No,  you  only  do 
it  once  every  three  months.’  It  turned  out  the  thing  went  out 
of  calibration  and  wouldn’t  shoot  a  thing!  They  had  to  go  in 
and  make  a  major  change  so  that  it  wouldn’t  go  out  of 
calibration.  But  it  wouldn’t  have  been  any  good  to  the  troops 
otherwise. 

It  comes  back  to  a  simple  thing  that  is  true  whether  the 
program  is  international  or  not.  You  are  trying  to  certify  to 
the  troops  that  the  system  will  work  the  way  that  it  is 
advertised.  That  is  the  first  time  that  Hughes  had  been 
through  one  of  MICOMs  root  cause  analysis.  They  learned  a 
lot. 

International  is  more  complex  Their  test  ranges  are  set  much 
like  ours  but  they  use  different  equipment.  Many  times 
there  are  quirks  in  the  test  range  that  you  don’t  find  until 
you  start  testing,  that  will  invalidate  the  test.  These  are 
things  the  TMO  needs  to  be  sensitive  to.  Many  times  it  is  the 
Italian  or  French  ombudsman  on  the  team  that  will  have  to 
go  back  and  tell  their  folks  that  they  are  messing  up.  [And 
this  is  potentially  embarrassing  to  the  country,  and  so 
communications  becomes  important]  (21  June  2001 
Interview  with  John  Robins). 


C.  LANCE 

Information  about  the  Lance  program  has  been  primarily  obtained 
from  an  interview  with  Mr.  John  Robins  who  was  the  civilian  Manager  for 
Lance.  While  Lance  did  not  involve  significant  international 
participation  during  development,  the  TMO  lessons  learned  have  merit. 
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1 .  Overview 

Figure  15  depicts  the  LANCE  missile  and  launcher.  LANCE  was  a 
mobile  field  artillery  tactical  missile  system  used  to  provide  both  nuclear 


Figure  15:  LANCE  MISSILE  (from 
http :  /  /  WWW.  redstone .  army .  mil  /  lance  /  summary .  html) 


and  non-nuclear  fire-support  to  the  Army.  It  was  designed  to  attack  key 
enemy  targets  beyond  the  range  of  cannon  artillery.  It  was  a  highly 
mobile,  medium-range,  fin  stabilized,  all  weather,  surface-to-surface 
missile  weapon  system.  LANCE’s  primary  mission  targets  were  enemy 
missile  firing  positions,  airfields,  transportation  centers,  command  and 
logistic  installations,  critical  terrain  features  (defiles,  bridgeheads,  main 
supply  routes,  etc.),  and  large  troop  concentrations. 

The  missile  was  incrementally  guided  using  the  Directional  Control 
Automatic  Meteorological  (DCAM)  compensation  concept.  The  LANCE 
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missile  was  launched  by  a  high  thrust  booster  that  propelled  it  out  to 
1500  meters.  The  boost  phase  direction  was  controlled  by  a  gyro 
commanding  secondary  injection  into  the  booster.  The  booster  cut  off 
and  the  variable  thrust  sustainer,  controlled  by  an  accelerometer, 
provided  the  exact  amount  of  thrust  to  equal  the  missile  drag.  The  result 
was  a  predictable  trajectory  that  essentially  eliminated  errors  caused  by 
atmospheric  disturbances  or  changes.  The  missile  was  aimed  using  field 
artillery  techniques  plus  the  variable  booster  time.  Unlike  other  Army 
missiles  that  use  solid  propellants,  the  LANCE  used  a  prepackaged, 
liquid  fuel  that  eliminated  any  need  for  fueling  in  the  field  and  gave 
LANCE  a  short  reaction  time.  It  was  capable  of  delivering  nuclear 
warheads  to  a  range  of  75  miles  and  conventional  warheads  to  a  range  of 
45  miles. 

LANCE  was  actively  deployed  until  the  early  1990s.  In  1991, 
President  George  Bush  announced  a  unilateral  cut  in  nuclear  weapons, 
which  was  followed  on  5  October  by  a  similar  announcement  by 
President  Mikhail  Gorbachev  of  the  U.S.S.R.  Although  the  Soviet  Union 
collapsed  shortly  thereafter,  the  United  States  later  reaffirmed  this 
nuclear  arms  reduction  agreement  by  signing  a  treaty  with  Russia, 
Belarus,  Kazakhstan,  and  Ukraine  on  23  May  1992.  The  final  LANCE 
battalion  stood  down  at  Fort  Sill,  Oklahoma,  on  30  June  1992.  After 
being  demilitarized,  excess  LANCE  missiles  were  set  aside  for  use  as 
targets  (http :  /  / www. redstone . army . mil /  history / lance /  summary . html) . 

2.  Application  of  the  TMO  Framework 

a.  TMO  Considerations 

Table  1 1  captures  the  TMO  considerations  elements  for 

LANCE. 
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Table  11:  LANCE  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

LANCE  was  developed  independently  by  the  U.S.  and  control  of  the 
program  remained  within  the  U.S.  for  the  life  of  the  system.  The 
International  community  became  involved  through  foreign  military 
sales  to  NATO  countries  and  Israel. 

2.  RDEC/ 
Contractor 
Technical 
Support 

Research  Development  and  Engineering  Center  (RDEC) /Contractor 
Technical  Support.  Technical  support  from  RDEC  and  other  sources 
played  a  crucial  role  in  the  development  of  Lance,  although 
international  considerations  for  technical  support  were  minimal.  A 
key-concept  that  made  Lance  possible  in  an  era  of  unreliable  and 
inaccurate  electronics  was  the  variable  thrust  sustainer,  conceived 
by  Dr.  McCorkle  and  Bob  Canard  at  RDEC.  Effective  exchange  of 
information,  including  this  key  concept,  between  the  Lance  TMO 
effort  and  the  prime  contractor  was  important  to  the  success  of  the 
program. 

3. 

Management 
of  Technical 
Requirements 

Management  of  Technical  Requirements  did  not  involve  the 
international  community.  Lance  was  developed  independently  by  the 
U.S.  Army,  and  the  configurations  of  upgrades  were  managed  by  the 
U.S.  Army. 

4. 

Management 
of  Technical 

Risk 

Management  of  Technical  Risk  involved  teamwork  between 
Government  TMO  and  contractor  developers.  Creation  of  detailed 
plans,  using  PERT  tools,  may  have  helped  to  identify  problem  areas 
early,  but  also  created  additional  risks.  There  were  no  technical 
risks  directly  associated  with  the  international  aspects  of  the 
program  since  the  international  involvement  began  following  the 
completion  of  the  development  activity. 

5.  Technical 

Monitoring 

Capability 

Technical  Monitoring  Capability  was  initially  centered  on  a  massively 
complex  PERT  based  schedule  and  resource  tracking  system. 

However,  when  it  became  apparent  that  the  PERT  based  approach 
was  not  being  effective,  the  approach  was  simplified  to  focus  detailed 
planning  on  near  term  events.  Quantified  milestones  were  instituted 
to  provide  intermediate  goals  that  had  to  be  met  in  order  to  continue 
development  beyond  clearly  defined  technical  goals.  However,  there 
were  no  international  considerations  for  technical  monitoring. 

6.  Direct 
Technical 
Contribution 

Direct  Technical  Contribution  from  TMO  was  crucial  to  LANCE. 
Concepts  developed  by  RDEC,  such  as  the  variable  thrust  sustainer 
made  LANCE  more  accurate  and  reliable  than  would  have  been 
possible  otherwise. 

7.  Control  of 
and  Access  to 
Technical  Data 

Control  of  and  Access  to  Technical  Data  was  not  an  issue  for  LANCE 
because  no  foreign  participation  occurred  during  development. 

8.  User 
Participation 

User  Participation  was  minimal  during  LANCE  development. 
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Table  11:  LANCE  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

9.  Cost  Share 
and  Work 

Share 

Cost  Share  and  Work  Share  were  not  an  issue  for  LANCE 
development.  During  production,  costs  for  purchase  of  LANCE  by 
other  nations  were  borne  by  the  purchasing  nation. 

10. 

Preparation  of 
Contract 

SOWS 

Preparation  of  Contract  Statements  of  Work  (SOW).  There  were  no 
international  considerations  associated  with  preparation  of  the 

LANCE  SOWS. 

b.  TMO  Program  Feedback  Considerations 

Table  12  has  the  TMO  Program  Feedbaek  elements  for 


LANCE. 

Table  12:  LANCE  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1. 

International 

Executive 

Control 

International  Executive  Control  was  not  applicable  for  LANCE. 

2.  TMO 

Funding 

TMO  Funding  did  not  include  any  unique  international  aspects. 

3.  National 
Interaction 

National  Interaction  was  not  an  issue  for  development  of  LANCE. 

4.  US 
Acquisition 
Review  prior  to 
next  phase 

There  were  no  unique  international  aspects  of  acquisition  review  for 
LANCE. 

D.  MEDIUM  EXTENDED  AIR  DEFENSE  SYSTEM  (MEADS) 

Information  for  this  MEADS  TMO  diseussion  has  been  taken 
primarily  from  an  interview  with  Mr.  William  Bishop,  22  July  2001,  and 
from  the  personal  experienees  of  the  author.  Mr.  Bishop  is  the  Chief 
Engineer  of  the  International  Program  Offiee  (IPO)  for  MEADS,  direeting  a 
teehnieal  staff  of  engineers  from  Italy,  Germany  and  the  United  States. 
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Mr.  Bishop  has  also  provided  invaluable  adviee  and  guidanee  to  the 
author  in  the  development  of  this  thesis.  The  author  is  on  teehnieal  staff 
to  the  U.S.  MEADS  National  Produet  Offiee  (NPO). 

1 .  Overview 

An  overview  of  the  planned  MEADS  system  is  shown  by  Figure  16. 


MEADS  SYSTEM  CONCEPT  (MSC) 


BMC4I 


Battle  Element  TOC 


Dynamic  Force  Tailoring 

-  Automatic  Initialization 

-  Reconfigurable  /  Plug  &  Fight 
Netted  &  Distributed 

-  Netted  Sensors  Provide  Continuous  & 
Redundant  Target  Track 

-  Distributed  Battle  Elements  Put  Best 
Weapon  on  Target 

-  Eliminates  Single  Point  of  Failure 
All  Sensors  and  TOCS  Tied  to  High 
Speed  Net 

Battalion-level  TOC  Coordinates 
External  Track  Data 


Surveillance  Radar 


Fire  Control  Radar 


Pulsed-Doppler  Phased-Array  With 
IFF  Sensor 

UHF  Operating  Frequency  Band 
Multi-Mode  Operation 

-  360°  Coverage  or  Fixed 
90°Sector  Operation 

-  Self  Contained  Alignment 
Mobile  &  Transportable 

-  Cross  Country  /  Truck 
Mounted 

-  C-130  Roll  On  /  Roll  Off 


Lightweight  Launcher  /  PAC-3  Missile 


•  Large  Power  Aperture  Active  Phased-Array 
X  Band  Radar 

•  Multi-Mode  Operation 

-  360°  All  Aspect  Coverage 

•  Self  Contained  Alignment 

•  Mobile  &  Transportable 

-  Cross  Country  /  Truck  Mounted 
-C-130  Roll  On /Roll  Off 


Mobile  & 

Transportable 
-  C-130  Roll  On  /  Roll  Off 


•  Self  Contained 
Alignment 

•  Erects  to  Vertical 
Launch  for  360° 

Coverage 

•  PAC-3  /  Missile  Compatible 

•  Palletized  Handling  System 
(PHS)  or  Crane  Reload 


•  Hit-to-Kill  Missile 

•  Proven  Technology 

•  Highly  Capable 


Figure  16:  MEADS  System  Concept  (from  US  MEADS  NPO 
Program  Documentation) 

MEADS  began  life  in  August  1990  in  the  U.S.  with  the  approval  of  the 
Corps  Air  Defense  Capability  Mission  Need  Statement  (MNS).  The  Army 
was  given  ORD  responsibility,  and  the  system  was  given  the  name 
CORPS  SAM.  The  Milestone  0  Aequisition  Deeision  Memorandum  (ADM) 
approved  entry  into  the  Coneept  Exploration  aequisition  phase  and 
required  the  projeet  offiee  to  explore  eooperative  opportunities  with  allied 
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countries.  Countries  eontaeted  for  potential  involvement  ineluded 
Australia,  Canada,  Franee,  Germany,  Israel,  Italy,  Japan,  Korea,  The 
Netherlands,  Norway  and  United  Kingdom.  In  the  1994  time  frame, 
detailed  diseussions  began  with  Germany  and  Franee.  In  1995,  Italy 
joined  the  diseussions  and  a  formal  Statement  Of  Intent  (SOI)  was 
signed.  An  interim  management  offiee  was  established  to  eoordinate 
program  aetivities  prior  to  establishment  of  the  NATO  MEADS 
Management  Ageney  (NAMEADSMA). 

Development  of  a  MEADS  Memorandum  of  Understanding  (MOU) 
was  begun  in  1996.  Franee  withdrew  prior  to  MOU  signing.  The 
Program  Definition/ Validation  (PD/V)  phase  was  initiated  to 
eompetitively  seleet  the  best  teehnieal  approaeh  and  to  seleet  the  MEADS 
prime  eontraetor.  MEADS  International  Consortium  ineluding  Loekheed- 
Martin,  won  the  eompetition. 

The  down-seleet  to  MEADS  International  was  eompleted  in 
Deeember  of  1999.  Shortly  after  the  down-seleet  was  eomplete,  funding 
eoneerns  within  the  U.S.  led  to  reeonsideration  of  U.S.  eommitment  to 
the  program.  An  Analysis  of  Alternatives  (AOA)  had  been  done  by  the 
U.S.  Army  Air  Defense  Sehool  (USAADASCH)  during  the  PD/V  phase 
along  with  a  Cost  As  and  Independent  Variable  (CAIV)  analysis  by  the 
U.S.  National  Produet  Offiee  (NPO).  The  U.S.  agreed  to  eontinue  the 
program  eontingent  on  use  of  the  PAC-3  missile  in  lieu  of  developing  a 
new  MEADS  missile.  Additionally,  full  program  funding  was  not 
eommitted  by  the  U.S.  and  an  interim  three  year  Risk  Reduetion  Effort 
(RRE)  was  established.  RRE  was  supposed  to  reduee  risk  and  provide  an 
opportunity  to  better  understand  program  eost.  The  U.S.  then 
established  full  funding  for  MEADS  in  the  Future  Years  Defense  Plan. 

The  ehange  in  the  program  led  to  a  re-evaluation  of  program 
eommitment  by  the  German  and  Italian  partners.  Complieating  matters, 
the  German  Government  ehanged  and  a  re-evaluation  of  German  defense 
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priorities  began.  However,  these  diffieulties  have  been  overeome,  and  the 
30  Month  RRE  eontraet  was  awarded  with  MEADS  International  in  July 
of  2001. 


2.  Application  of  the  TMO  Framework 
a.  TMO  Considerations 

Table  13  eaptures  the  TMO  Consideration  elements  for 

MEADS. 


Table  13:  MEADS  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

Italy,  Germany  and  the  United  States  are  partners  in  the  MEADS 
program.  Current  and  planned  Memorandum  Of  Understandings 
(MOUs)  establish  the  MEADS  program  as  an  international  co¬ 
development  program,  where  the  three  nations  establish  operational 
requirements,  select  the  prime  contractor,  develop  the  system,  and 
produce  the  system. 

2.  RDEC/ 
Contractor 
Technical 

Support 

Access  by  the  IPO  to  Research  Development  and  Engineering  Center 
(RDEC) /Contractor  Technical  Support  for  MEADS  TMO  is  proving  to 
be  difficult.  Some  access  is  provided  through  U.S.  NPO  that  is  not 
subject  to  Cost  Share/ Work  Share.  The  IPO  does  have  access  to 
Contractor  Technical  Support  that  is  subject  to  cost  share  and  work 
share. 

3.  Management 
of  Technical 
Requirements 

User  requirements  have  been  clarified  and  updated,  particularly 
related  to  system  interoperability  with  other  Joint  system. 

Obtaining  international  agreement  for  clarifications  and  updates  of 
the  International  Technical  Requirements  Document  (ITRD)  may 
prove  difficult. 

4.  Management 
of  Technical 

Risk 

Technical  Risk  Management  is  made  more  difficult  for  MEADS 
because  of  technology  transfer  restrictions.  The  United  States 

Army  would  like  to  include  its  most  advanced  (and  sensitive)  missile 
and  sensor  technology  in  the  MEADS  system.  However,  the  U.S. 
plan  to  time  phase  the  foreign  release  of  sensitive  technology  critical 
to  the  MEADS  program  complicates  risk  management.  The  IPO  is 
not  able  to  address  this  risk  early  in  the  program,  and  will  not  be 
able  to  address  this  risk  until  the  technology  is  released.  This  is  a 
dilemma  for  all  parties  and  is  an  area  where  the  U.S.  MEADS  NPO 
can  help  to  address  technical  risk.  Some  strain  is  put  on  the 
international  partnership  when  partial  access  to  MEADS  critical 
technology  is  provided  by  any  of  the  partners.  This  has  caused 
some  frustration. 
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Table  13:  MEADS  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

5.  Technical 

Monitoring 

Capability 

Technical  Monitoring  Capability  for  the  MEADS  program  will  be 
performed  by  NAMEADSMA’s  TMO  activity.  While  the  details  have 
not  yet  been  worked  out,  performance  metrics  will  be  developed  to 
measure  key  performance  parameters.  Software  metrics  will  be 
used  to  help  understand  software  development  status  and  an 
earned  value  management  system  will  be  used  to  understand 
expended  resources  for  planned  activities. 

6.  Direct 
Technical 
Contribution 

f.  At  appropriate  times  it  is  crucial  to  clarify  existing  requirements 
and  in  some  cases  it  may  be  necessary  to  add,  modify  or  delete 
requirements.  Development  of  contract  Statement  Of  Work  for 
future  contracts  is  important.  Activities  that  will  directly  impact 
MEADS  TMO  include  trade  studies,  contract  technical  deliverables, 
electronic  data  access,  scheduled  reviews,  simulations,  quality 
assurance,  configuration  management,  training,  logistics,  test 
requirements,  subcontractor  flow-down,  and  coordination  with 
external  programs. 

7.  Control  of 
and  Access  to 
Technical  Data 

Configuration  Management  (CM)  and  Government  approvals  to  use 
information  are  difficult  areas  for  MEADS.  For  CM,  delays  in 
approving  changes  to  requirements  and  specifications  can  be 
expected  due  to  the  international  nature  of  the  program.  Related  to 
Government  approval  for  use  of  sensitive  information,  a  specific 
time  phased  release  plan  has  been  developed  to  govern  the  timing  of 
the  release  of  specific  information,  such  as  PAC-3  missile 
information.  The  U.S.  does  not  wish  to  release  information  before  it 
is  needed  in  the  program,  particularly  because  the  partner  nations 
(including  the  U.S.)  have  not  yet  committed  to  participate  in  the  full 
up  development  program. 

8.  User 
Participation 

User  Participation  is  different  for  European  development  programs 
than  for  typical  U.S.  Army  development  programs.  In  U.S.  Army 
programs,  user  participation  is  encouraged  early  and  throughout 
development  for  feedback  on  technical  aspects  that  will  affect  the 
User.  However,  in  Europe  the  same  is  not  done.  This  difference  in 
approach  will  be  addressed  as  the  MEADS  program  continues. 

9.  Cost  Share 
and  Work  Share 

The  twin  issues  of  MEADS  Cost  Share  and  Work  Share  have  a  large 
impact  on  TMO  for  MEADS.  It  is  tempting  to  leave  these  issues  to 
others  to  deal  with,  but  the  issues  affect  TMO  at  every  level.  This 
affects  prime  contractor  work  allocation,  it  can  affect  technical 
support  contractor  personnel  selection,  it  affects  the  organization  of 
the  NAMEADSMA  office  and  if  affects  the  ability  of  NAMEADSMA  to 
obtain  expert  technical  support  on  short  notice  when  problems  need 
to  be  solved. 
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Table  13:  MEADS  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

10.  Preparation 
of  Contract 

SOWS 

Preparation  of  MEADS  Contract  Statements  of  Work  (SOW)  are  more 
complex  for  the  MEADS  program  than  for  a  typical  U.S.  MDAP.  For 
a  U.S.  MDAP,  the  PM  typically  is  given  minimal  external  oversight  in 
structuring  contract  SOWs.  However,  in  MEADS,  the  three  partner 
nations  have  taken  a  strong  interest  in  ensuring  the  contract  SOWs 
with  the  prime  contractor  satisfy  national  interests.  This  makes 
preparation  of  SOW  time  consuming  and  requires  extra  up-front 
planning. 

b.  TMO  Program  Feedback  Considerations 

Table  14  captures  the  TMO  Program  Feedback  elements  for 


MEADS. 


Table  14:  MEADS  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1 .  International 
Executive 

Control 

Executive  control  for  MEADS  is  more  difficult  than  executive  control 
for  a  U.S.  only  MDAP  because  there  are  more  customers.  The  more 
participants  there  are  in  any  activity,  the  harder  it  is  to  please 
everybody.  For  MEADS,  the  TMO  issues  that  involve  difficult 
executive  action  are  system  requirements,  prime  contractor  work 
requirements,  and  balanced  work  share. 

2.  TMO 

Funding 

b.  An  important  issue  with  MEADS  TMO  Funding  relates  to 
balancing  work  share  to  match  MOU  agreements.  Some  limited 
funding  is  available  within  the  NPOs  that  is  not  subject  to  work 
share  considerations,  however,  use  of  this  funding  is  at  the 
discretion  of  each  NPO.  Although  operating  outside  the  IPO,  some 
useful  contribution  has  been  made  as  a  result  of  independent  NPO 
funding,  and  it  is  hoped  that  future  collaborative  effort  is  possible. 

3.  National 
Interaction 

c.  National  Interaction  between  NAMEADSMA  and  the  partner 
nations  is  both  enjoyable  and  frustrating.  It  is  enjoyable  because 
participants  can  meet  and  get  to  know  interesting  people  from  other 
countries  who  have  a  common  purpose.  The  frustrating  part 
involves  restrictions  on  communications  and  technical  exchanges 
resulting  from  the  MEADS  MOU  and  national  regulations. 
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Table  14:  MEADS  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

4.  US 

Acquisition 
Review  prior  to 
next  phase 

d.  U.S.  Acquisition  Review  Prior  to  the  Next  Program  Phase  is 
critical  for  the  eventual  success  of  the  MEADS  program.  Navigating 
the  waters  of  the  National  acquisition  processes  is  difficult  for 
NAMEADSMA  because  direct  access  to  the  National  decision  making 
processes  is  not  available  to  NAMEADSMA.  Complicating  things 
even  more  regarding  the  U.S.  acquisition  process,  acquisition 
personnel  in  the  U.S.  are  not  accustomed  to  international 
acquisition. 

3.  Elaboration 

a.  Discussion:  MEADS  Program  International 
Organization 

Figure  17  highlights  key  aspeets  of  the  eurrent  MEADS 
organization.  The  North  Atlantie  Treaty  Organization  (NATO)  MEADS 
Management  Ageney  (NAMEADSMA),  establishes  and  exeeutes  eontraets 
with  the  MEADS  Prime  Contraetor,  MEADS  International.  The  U.S. 
MEADS  NPO  supports  the  U.S  Steering  Committee  member,  and 
provides  an  interfaee  to  NAMEADSMA  to  the  U.S.  aequisition 
infrastrueture.  The  MEADS  Exeeutive  Subeommittee  (MESC)  is  an 
international  eoordinating  body  that  supports  the  Steering  Committee, 
whose  membership  ineludes  the  Produet  Managers  from  eaeh  nation’s 
NPO. 

It  may  appear  to  the  U.S.  aequisition  eommunity  as  if  the 
U.S.  MEADS  NPO  is  responsible  for  the  program.  It  is  not.  As  shown 
figure  17,  a  U.S.  MEADS  National  Produet  Offiee  (NPO),  separate  from 
NAMEADSMA,  supports  the  U.S.  Steering  Committee  member  and 
provides  NAMEADSMA  a  primary  point  of  eontaet  for  interaeting  with  the 
U.S.  aequisition  eommunity.  The  U.S.  MEADS  NPO  internets  with  the 
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Figure  17:  MEADS  Management  Structure  (from  US  MEADS  NPO 

Program  Documentation) 

U.S.  Defense  Aequisition  Exeeutive,  Overarehing  Integrated  Proeess 
Team  (OIPT),  Integrating  Integrated  Proeess  Team  (IIPT)  and  Working 
Integrated  Proeess  Teams  (WIPTs).  The  NPO  plays  another  role  beeause 
of  the  U.S.  desire  to  limit  foreign  aeeess  to  teehnology.  The  U.S.  MEADS 
NPO  faeilitates  teehnology  transfer,  while  ensuring  proper  foreign  release 
approve  is  obtained  prior  to  transfer.  The  U.S.  MEADS  NPO  also  does 
some  teehnieal  work  to  understand  and  mitigate  teehnieal  risk. 

(1)  MEADS  TMO  Organizational  Aspeets  and 
NAMEADSMA.  The  NAMEADSMA  engineering  division  is  responsible  for 
MEADS  TMO.  TMO  is  more  eomplex  for  NAMEADSMA  than  for  a  U.S. 
only  program.  This  is  due  to  diffieulties  in  ehanging  organization 
strueture  to  mateh  teehnieal  needs  and  to  mateh  the  abilities  of  the 
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engineering  staff.  The  basie  NAMEADSMA  organization  strueture  was 

established  by  the  MOU,  roughly  aeeording  to  work  sharing  agreements, 

and  ehanges  to  that  strueture  must  be  approved  by  the  Steering 

Committee.  However,  the  Nations  feel  they  own  the  positions  that  have 

been  alloeated,  and  this  makes  it  diffieult  to  move  people  within  the 

organization  as  needs  ehange.  Fortunately,  eaeh  nation  has  brought 

talented  people  into  the  program  and  this  helps  to  offset  the  problem. 

The  nations  tend  to  look  at  those  positions  as  if  they  own 
those  positions,  therefore  they  have  a  say  in  what  those 
positions  do.  That  is  not  unique  to  MEADS.  They  have  the 
same  sort  of  thing  in  Europe  where  they  do  international 
programs.  This  is  just  one  of  those  things  that  with  an 
international  program  you  get  involved  in.  The  nations  tend 
to  design  the  organization,  somewhat,  and  to  a  large  extent, 
organize  it  based  on  work- share  and  primarily  on  the  tasks 
that  need  to  be  done.  Now  they  don’t  ignore  work  to  be 
done,  but  work  share  eonsiderations  are  additional 
eonstraints  on  the  organization.  (Interview  with  William 
Bishop,  22  July  2001). 


(2)  MEADS  TMO  Organizational  Aspeets,  the  Steering 
Committee  and  the  MESC.  The  Steering  Committee  oversees  the 
aetivities  of  NAMEADSMA  and  the  MESC,  eonsisting  of  the  head  of  the 
NPOs  from  eaeh  nation  supports  the  Steering  Committee.  The  Steering 
eommittee  does  not  get  involved  in  the  day  to  day  teehnieal  deeisions 
that  affeet  NAMEADSMA  TMO.  Some  teehnieal  issues  related 
requirements  and  teehnieal  Statements  of  Work  (SOWs)  get  speeial 
steering  eommittee  attention,  beyond  the  exeeutive  attention  that  would 
oeeur  for  a  U.S.  only  program.  For  a  U.S.  only  program,  oversight  ean  be 
expeeted  for  requirements,  through  the  Operational  Requirements 
Doeument.  However,  a  U.S.  Program  Manager  (PM)  will  normally  own 
the  SOW  and  system  speeifieation.  NAMEADSMA  must  obtain  approval 
of  the  Steering  Committee  for  substantive  ehanges  to  the  eontraet 
teehnieal  speeifieation  and  the  SOW.  This  affeets  TMO  beeause  the 
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process  for  establishing  the  basis  for  and  any  ehanges  to  the  work  to  be 
performed  are  tedious  and  time  eonsuming. 

(3)  MEADS  TMO  Organizational  Aspeets  and  the  U.S. 
MEADS  NPO.  As  with  all  U.S.  personnel  external  to  NAMEADSMA,  the 
teehnieal- staff  within  the  U.S.  MEADS  NPO  have  diffieulty  with  the 
reality  that  the  U.S.  is  not  in  eontrol  of  the  MEADS  program.  This 
eonfusion  may  exist  beeause  of  limited  international-program  experienee, 
the  need  to  exehange  teehnieal  information  with  other  U.S.  programs, 
and  the  desire  by  individuals  to  make  meaningful  teehnieal 
eontributions.  As  with  any  group  it  takes  some  time  to  sort  out  and 
fully  understand  roles  and  responsibilities.  While  working  teehnieal 
transfer  issues  and  eoordinating  with  other  programs,  opportunities  are 
oeeurring  for  U.S.  MEADS  NPO  teehnieal  personnel  to  eontribute 
expertise.  Coordination  between  NAMEADSMA  and  the  U.S.  MEADS 
NPO  has  begun  to  oeeur  to  foeus  U.S.  MEADS  NPO  teehnieal  resourees 
on  the  teehnieal  issues  that  need  to  be  worked.  To  the  extent  that  U.S. 
personnel  are  seen  as  supporting  NAMEADSMA,  this  will  be  sueeessful 
(Author’s  opinion). 

b.  Discussion:  RDEC/Contractor  Technical  Support 

There  is  reeognition  by  NAMEADSMA  and  all  of  the  national 
partieipants  of  the  potential  high  value  of  RDEC  teehnieal  support,  but 
no  meehanism  has  been  established  to  enable  eontrol  and  traeking  of 
teehnieal  support  work  share  when  RDEC  is  involved.  To  partially 
overeome  this  diffieulty,  a  System  Engineering  Teehnieal  Assistanee 
(SETA)  eorporation,  MEADS  Limited  Liability  Corporation  (LLC),  has 
ereated  to  provide  NAMEADSMA  aeeess  to  teehnieal  support.  MEADS 
LLC  will  help  to  fill  the  teehnieal  support  needs  of  the  MEADS  program, 
but  there  remains  a  desire  to  enable  aeeess  to  RDEC  beeause  of  proven 
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expertise  with  simulations,  software  and  radar  teehnology.  Some 
support  from  RDEC  is  planned  through  the  U.S.  MEADS  NPO,  however, 
this  support  is  not  subjeet  to  eost  sharing  and  is  diffieult  to  justify. 

Within  the  U.S.  it  is  felt  that  the  eosts  for  teehnieal  support  should  be 
shared  by  all  the  partners  beeause  all  partners  benefit.  However,  some 
teehnieal  aspeets  of  MEADS  are  uniquely  U.S.,  German  or  Italian,  sueh 
as  interfaee  to  national  eommand  and  eontrol  systems,  and  applying 
independent  funding  to  solve  teehnieal  problems  unique  to  the  U.S.  use 
of  MEADS  may  be  justified.  U.S.  funded  teehnieal  support  for  interfaeing 
with  U.S.  provided  subsystems  sueh  as  PAC-3  may  be  justified  beeause 
time  phased  aeeess  to  PAC-3  information  is  being  provided.  Ultimately, 
support  from  RDEC  to  the  MEADS  program  may  have  to  be  funded 
independent  of  eost  share  agreements,  however,  a  method  of  satisfying 
the  MOU  eost  share  agreement  would  be  preferable,  at  least  from  the 
U.S.  perspeetive. 

An  example  of  the  U.S.  MEADS  NPO  providing  teehnieal 
support  with  direet  impaet  on  MEADS  TMO  involves  frequeney  alloeation 
support.  It  is  in  the  interest  of  the  three  MEADS  partner  nations  to 
ensure  the  frequeneies  to  be  used  by  MEADS  radars  are  aeeeptable  for 
the  areas  in  the  world  where  MEADS  is  expeeted  to  be  deployed. 

Ensuring  this  involves  analysis  of  internationally  agreed  upon  frequeney 
alloeation  tables.  While  on  the  surfaee  this  appears  straight  forward,  it 
is  not.  Demand  for  speetrum  has  exploded  during  the  last  deeade,  and  it 
is  beeoming  diffieult  to  ensure  radars  will  have  the  speetrum  available  for 
operations.  In  any  ease,  the  U.S.  MEADS  NPO  is  dedieating  effort  to 
address  this  problem  until  the  issue  is  resolved.  This  effort  is 
independent  of  eost  share  and  work  share  eonsiderations.  Italy  and 
Germany  are  supporting  similar  efforts.  NAMEADSMA  is  playing  a 
eoordinating  role,  but  is  not  funding  the  support. 
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c.  Discussion:  Management  of  Technical  Requirements 

Management  of  teehnieal  requirements  in  any  eomplex 
system  development  is  diffieult.  On  the  one  hand,  requirements  stability 
is  desired  in  order  to  minimize  ehange  and  resulting  eost.  On  the  other 
hand,  if  the  requirement  is  wrong  and  a  ehange  will  be  needed  later 
an5rway,  then  eonventional  wisdom  is  that  the  earlier  the  error  is 
eorreeted,  the  lower  the  eost  will  be.  In  the  International  Considerations 
seetion  of  this  thesis,  (Seetion  C,  Chapter  II)  the  eommon  desire  of 
international  programs  to  avoid  requirements  ehange  was  highlighted. 
MEADS  is  no  different.  Within  the  TMO  staff  of  MEADS  there  is  a 
growing  awareness  that  the  International  Requirements  Doeument  needs 
elarifieation  in  many  areas.  However,  there  is  strong  reluetanee  to  add, 
delete  or  ehange  the  intent  of  any  requirement.  The  ITRD  will  establish 
the  teehnieal  requirements  for  the  MEADS  eontraet  when  the  formal 
development  program  begins. 

From  the  perspeetive  of  requirements  stability  it  is  good  not 
to  ehange  the  ITRD.  From  the  perspeetive  of  the  U.S.  User,  however, 
ehange  is  neeessary  to  align  the  ITRD  the  U.S.  MEADS  Operational 
Requirements  Doeument,  whieh  has  ehanged  in  some  of  its  teehnieal 
detail.  During  the  world-wide  staffing  approval-proeess  of  the  U.S. 
MEADS  ORD,  detail  has  been  added  that  makes  the  ORD  ineonsistent 
with  the  ITRD.  Fortunately,  mueh  of  the  ehange  to  the  ITRD  that  is 
desired  by  the  U.S.  ean  be  looked  at  as  a  elarifieation  of  an  existing  ITRD 
requirement.  Also  fortunately,  the  US  ORD  remains  almost  entirely 
eonsistent  with  the  International  Common  Operating  Requirements 
(ICOR)  doeument,  whieh  is  intended  to  serve  the  funetion  of  the  ORD  for 
the  MEADS  program. 

The  U.S.  MEADS  NPO  has  expended  eonsiderable  resourees 
over  the  eourse  of  a  year  to  understand  the  differenees  that  have 
emerged  between  the  ORD  and  the  ITRD,  and  to  suggest  elarifieation 
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language  for  the  ITRD.  NAMEADSMA  has  also  expended  eonsiderable 
resourees  in  trying  to  understand  the  nature  of  the  suggested 
elarifieations.  The  need  has  been  reeognized  by  both  organizations  to 
eollaborate  at  least  to  understand  the  issues.  It  remains  to  be  seen 
what,  if  any  elarifieations  or  ehanges  are  made  as  a  result  of  this 
requirements  review  proeess.  This  experienee  highlights  the  diffieulty  of 
managing  requirements  ehange  for  an  international  program,  even  prior 
to  start  of  formal  development. 


d.  Discussion:  Configuration  Control 

Configuration  Control  of  teehnieal  data  is  eritieal  for  any 

program.  The  uniqueness  for  MEADS,  is  that  getting  three  nations  to 

agree  upon  a  partieular  ehange  is  diffieult.  An  effeetive  meehanism  for 

timely  approval  of  engineering  ehanges  during  the  future  development 

effort  has  not  been  established. 

It  is  usually  diffieult  to  obtain  Steering  Committee  agreement 
on  eomplex  teehnieal  issues  in  a  timely  manner.  From  that 
standpoint,  I  don’t  yet  know  how  we  are  going  to  do 
eonfiguration  management  downstream  during  the  D&D 
program  phase.  The  Steering  Committee  is  presently  the 
only  body  that  ean  approve  an  engineering  ehange  to  the 
teehnieal  requirements.  I’ve  been  on  development  programs 
where  you  have  had  to  proeess  performanee  requirements 
ehanges  within  a  matter  of  a  few  days.  You  found  something 
out,  you’ve  got  to  make  a  ehange.  Unless  the  General 
Manager  is  appointed  ehairman  of  a  CM  board,  it  will  take 
us  a  long  time  to  obtain  agreements  for  ehange.  Then  we 
will  have  a  lengthy  delay,  diminishing  our  ability  to  respond 
to  dynamie  situations  in  a  timely  manner.  (William  Bishop 
Interview,  22  July  2001). 


e.  Discussion  and  Example:  User  Participation 

For  MEADS  Germans  and  Italians  have  diffieulty  with  the 
idea  of  getting  their  User  involved  onee  the  initial  requirements  have 
been  established. 
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This  is  a  unique  thing  that  weVe  run  into,  and  it’s  one  of 
those  things  that  I  just  have  to  file  as  ineredible.  There  is  a 
mindset  in  the  US  that  during  the  aequisition  proeess  when 
you’re  building  advaneed  systems  you  want  user 
involvement,  praetieally  from  day  one.  And  you  want  user 
involvement  praetieally  through  the  entire  program.  You 
even  have  a  TPiADOC  system  manager  who  is  at  roughly  the 
same  level  as  the  program  manager  in  the  aequisition  ehain. 

But  Europeans  don’t  neeessarily  do  that.  And,  some  of  them 
have  a  diffieult  time  in  wanting  to  bring  their  user  people 
into  the  proeess  at  all.  That  is  something  that  has 
astounded  me.  And  I  don’t  know  the  baekground  of  why 
that  is,  but  in  Germany  and  Italy’s  proeess.  I’ve  learned  to 
aeeept  their  reluetanee  for  direet  user  involvement  in  the 
aequisition  proeess.  To  them  it  probably  makes  perfeet 
sense.  They  have  established  their  proeedures  for  getting 
user  input  into  requirements  and  there  is  very  little  if  any 
(that  I  ean  diseern)  direet  user  input  into  projeet  offiees  in 
Germany  or  Italy.  So,  when  you  see  the  need  for  user  input 
and  you  have  to  go  to  the  three  nations  to  request  User 
partieipation,  then  the  US  has  a  tough  time  getting  that  view 
aeross.  And  that  problem  has  to  be  solved,  in  my  opinion, 
for  all  three  nations,  beeause  we  are  ultimately  building 
something  for  the  user.  You  just  don’t  want  to  go  for  8  years 
and  suddenly  drop  something  on  the  user.  (William  Bishop 
Interview,  22  July  2001). 

An  example  of  the  differenee  between  U.S.  user  partieipation 
and  European  User  partieipation  involves  operational  testing.  In  the 
U.S.,  a  system  operational  test  involving  Users  in  an  operational 
eonfiguration  is  mandated  by  law  prior  to  fielding  of  the  system.  There  is 
no  relief  given  to  international  programs.  There  is  no  similar 
requirement  in  Europe.  To  some  extent  this  might  be  solved  by  how  the 
developmental  test  program  is  struetured  for  MEADS.  It  may  be  possible 
to  obtain  agreement  for  a  partial  operational  test  of  the  system  that 
demonstrates  eore  funetionality  that  is  eommon  for  all  three  nations. 
However,  this  may  take  a  ehange  in  thinking  on  the  part  of  all  three 
nations.  Otherwise  we  may  end  up  effeetively  with  three  operational 
tests,  and  that  will  not  be  eost  effeetive. 
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/.  Cost  Share  and  Work  Share  Importance  to  TMO 


Cost  Share  and  Work  Share,  ...  that  is  a  super,  super,  super, 
biggy  for  TMO.  You  almost  want  to  say.  Veil  that  is  polities.’ 
But  you  ean’t  do  that.  You  would  like  to  foeus  on  just  the 
Engineering.  But  the  engineering  affeets  work-share!  I’ve 
spent  too  many  hours  talking  work-share.  But,  this  a  big, 
big  thing  in  a  international  program,  partieularly  to  the 
Europeans.  It  ought  to  be  to  the  US  too,  but  I  think  the 
Europeans  have  more  experienee  with  international 
programs,  and  they  understand  eost-share  and  work-share 
beeause  they  have  had  to.  And  that  has  to  be  balaneed,  just 
like  a  lot  of  other  things  on  the  program.  And  that  is  at  the 
Steering  Committee  level,  and  they  have  to  work  through 
that,  but  it  is  a  really  big  impaet  and  this  is  another 
eharaeteristie  that  makes  TM  unique  on  international 
program. 


How  ean  that  affeet  you?  Well,  things  that  you  want  to  do  in 
terms  of  putting  people  on  a  partieular  problem.  If  its 
outside  of  a  support  eontraet  and  you  feel  you  need  speeial 
expertise  somewhere,  then  that  beeomes  an  item  for  eost 
share/ work  share.  It  ought  not  to  be  that  way,  but  it  is.  If  I 
have  an  unexpeeted  fire  going  on  at  my  house  and  I  have  to 
eall  the  fire  department,  then  that  work  will  get  involved  in  a 
eost  share/ work  share  issue  that  we’ll  have  to  resolve  later 
on,  somehow.  That’s  just  a  faet  of  life.  That  affeets  TM  fairly 
substantially.  [William  Bishop  Interview,  22  July  2001). 


g.  Discussion:  Statement  of  Work 

The  tri-nation  involvement  in  SOW  preparation  has  led  to 
inereased  time  to  eoordinate  with  staff  from  the  three  NPOs  to  prepare 
eontraet  SOWs. 

Cost  share / work  share  issues  flow  into  Contraet  SOW 
preparation.  Not  only  is  it  that  you  have  to  worry  about  what 
it  is  you  have  got  to  do  to  aeeomplish  the  work,  but  also  that 
SOW  will  be  looked  at  by  the  nations,  in  terms  of  Svhat  is  in 
it  for  our  industry.’  The  prime  eontraetor,  when  he 
proposes,  has  to  look  at  the  SOW  and  the  eost  share/ work 
share  eonstraints  that  he  has  and  he  has  to  balanee  the  best 
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he  can.  That  is  not  easily  done,  but  he  has  to  figure  out  how 
to  do  it.  ...  You  mentioned  earlier  about  the  nations 
reviewing  the  SOW,  ...  that  was  a  horrendous  exercise,  and 
you  just  have  to  face  the  fact  that  SOWs  are  going  to  take  a 
long  time  to  coordinate.  And  we  have  to  figure  out  a  better 
way  to  do  it.  1  don’t  think  we  did  the  last  process  very  well. 
We  are  going  to  have  to  do  a  better  job  for  the  Design  and 
Development  (D&D)  phase.  But  that  is  something  the 
nations  are  going  to  get  involved  in  ,and  meticulously  pick 
over  words  and  paragraphs,  and  that’s  just  the  nature  of  the 
beast,  it  comes  with  the  territory.  But  that  is  a  unique  thing 
about  international  programs.  A  draft  D&D  SOW  exists,  but 
there  are  other  things  that  have  impacted  it.  What  we  don’t 
want  to  do  is  go  in  and  open  up  things  that  have  already 
been  settled.  But  there  have  already  been  impacts  to  that 
D&D  program.  That  SOW  will  not  be  a  simple  thing  to 
coordinate.  1  don’t  know  any  other  way  to  do  it  than  to  get 
started  on  it  early,  because  it  is  probably  going  to  be  harder 
and  take  longer  than  anticipated  (William  Bishop  Interview, 
22  July  2001). 


h.  Discussion.  National  Interaction 

For  MEADS,  national  acquisition  process  interaction  is 
either  formally  through  the  Steering  Committee  or  informally  through 
other  means.  In  the  case  of  interaction  with  the  U.S.,  most  informal 
interaction  is  through  the  U.S.  MEADS  NPO.  This  is  to  done  to  help 
ensure  that  the  U.S.  speaks  with  one  voice  when  interacting  with 
NAMEADSMA  and  to  help  ensure  that  sensitive  U.S.  information 
provided  to  NAMEADSMA  is  authorized  for  use  in  the  MEADS  program. 
Often  U.S.  personnel  working  for  NAMEADSMA  feel  cut  off  and  as  if  they 
are  being  treated  as  second  class  citizens  because  they  are  sometimes 
treated  as  foreign  nationals  (For  security  purposes,  NAMEADSMA  is 
considered  a  foreign  agency).  However,  part  of  the  issue  here  is  the 
discomfort  felt  by  Italian  and  German  NAMEADSMA  personnel  when  U.S. 
NAMEADSMA  personnel  participate  in  U.S.  only  activities.  Both 
viewpoints  are  understandable  and  difficult  to  address.  The  result  is 
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that  often  the  U.S.  personnel  at  NAMEADSMA  are  not  able  to  partieipate 
in  U.S.  aequisition  meetings  or  teehnieal  meetings  that  may  have  a  direet 
bearing  on  the  program.  This  uneomfortable  situation  is  being  handled 
on  a  ease  by  ease  basis  by  management  and  individuals. 

i.  Discussion.  U.S.  Acquisition  Review  Prior  to  the  Next 
Program  Phase 

U.S.  Aequisition  Review  Prior  to  the  Next  Program  Phase  is 
eritieal  for  the  sueeess  of  MEADS.  Navigating  the  waters  of  the  National 
aequisition  proeesses  is  diffieult  for  NAMEADSMA  beeause  direet  aeeess 
to  the  National  deeision  making  proeesses  is  not  available  to 
NAMEADSMA.  Complieating  things  regarding  the  U.S.  aequisition 
proeess,  U.S.  aequisition  personnel  are  not  aeeustomed  to  international 
aequisition.  U.S.  statutes  and  regulations,  developed  during  the  Cold 
War,  and  evolving  over  time  have  not  yet  eaught  up  with  international 
MDAP  aequisition,  although  mueh  progress  has  been  made.  Ideally,  one 
proeess  would  exist  for  the  U.S.,  Germany  and  Italy  to  deeide  upon 
eontinuation  of  the  program  at  the  end  of  eaeh  program  phase.  However, 
there  are  three  separate  proeesses,  eaeh  with  its  own  data  requirements 
and  institutional  deeision  eriteria. 

The  U.S.  MEADS  NPO  plays  a  eritieal  role  in  the  U.S. 
aequisition  proeess  to  transfer  data  from  the  MEADS  program  to  the  U.S. 
deeision  makers  to  enable  eontinuation  past  the  eurrent  Risk  Reduetion 
Effort  and  into  the  MEADS  D&D  phase  (roughly  equivalent  to  the  DOD 
5000  System  Development  and  Demonstration  phase,  see  Figure  18). 

This  is  an  uneomfortable  role  for  the  U.S.  MEADS  NPO 
beeause  the  NPO  is  aeeountable  to  the  U.S.  aequisition  proeess  for 
program  performanee  but  has  no  responsibility  for  program  exeeution. 
The  January  2001  updates  to  DODD  5000.1  and  DODI  5000.2,  along 
with  the  June  2001  update  to  the  Mandatory  MDAP  proeedures  in 
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ACQUISITION  PROCESS 
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Figure  18:  MEADS  Acquisition  Compared  with  DOD  5000  (from  US 
MEADS  NPO  Program  Documentation) 

DOD  5000. 2-R  include  special  considerations  for  international  programs, 
however,  the  U.S.  MEADS  NPO  is  severely  challenged  to  address  the 
expectations  of  the  U.S.  acquisition  process.  The  basic  difficulty  is  that 
acquisition  documentation  normally  developed  by  an  MDAP  PM  are  not 
being  developed  by  NAMEADSMA.  Yet  the  U.S.  acquisition  community 
expects  these  documents.  To  obtain  the  documents  desired,  the  U.S. 
MEADS  NPO  may  have  to  independently  develop  the  documents. 

However,  this  is  not  the  desired  solution,  it  would  be  better 
for  the  U.S.  to  rely  on  a  common  set  of  acquisition  documents  developed 
by  NAMEADSMA  that  will  satisfy  all  of  the  partner  nations.  To  make  this 
possible,  relief  may  be  needed  from  DOD  5000. 2-R,  June  2001  that 
states  in  paragraph  C7. 11.3.3  the  following:  “C7. 11.3.3  The  DoD 
Component  shall  remain  responsible  for  preparation  and  approval  of 
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DoD-required  documentation  and  reports  (speeifieally:  ORD,  C4ISP, 
TEMP,  APB,  Delegation  of  Diselosure  Authority  Letter,  ete.).” 

In  some  eases  the  doeuments  have  been  prepared  or  are 
being  prepared  and  in  some  eases  the  need  for  these  standard  U.S. 
doeuments  is  being  debated.  The  U.S.  Army  Air  Defense  Sehool 
(USAADASCH)  is  eontinuing  to  staff  and  update  the  U.S.  MEADS  ORD. 
An  attempt  was  made  in  1998  to  eliminate  the  ORD  in  favor  of  the  ICOR, 
however,  this  was  not  sueeessful  and  the  MEADS  ORD  remains  a  key 
U.S.  aequisition  doeument.  The  Command,  Control,  Computers  and 
Intelligenee  Support  Plan  (C4ISP)  is  being  developed  by  the  U.S.  MEADS 
NPO.  This  doeument  will  support  development  of  an  international 
version  that  is  being  eonsidered  for  development  by  NAMEADSMA.  A 
eommon  test  plan  will  be  developed  by  NAMEADSMA  that  although  not 
ealled  a  Test  and  Evaluation  Master  Plan  (TEMP),  is  hoped  will  satisfy  the 
U.S.  aequisition  proeess  and  the  aequisition  proeesses  for  all  national 
partieipants. 

The  bottom  line  for  U.S.  aequisition  review  prior  to  the  next 
program  phase  of  the  MEADS  program  is  that  the  proeess  will  be  diffieult 
and  elose  eooperation  will  be  needed  between  the  U.S.  MEADS  NPO  and 
NAMEADSMA.  Fortunately,  a  foundation  of  eooperation  and 
eollaboration  is  developing  within  the  TMO  arena.  There  is  reason  for 
optimism  that  the  U.S.  aequisition  proeess  will  obtain  the  information 
needed  to  deeide  whether  or  not  the  U.S.  will  eontinue  partieipation  in 
the  MEADS  program  into  the  D&D  phase. 

E.  INTERNATIONAL  SPACE  STATION  (ISS) 

Information  for  the  International  Spaee  Station  TMO  diseussion  is 
primarily  from  an  interview  with  Mr.  John  Wineh,  who  was  a  Boeing 
Engineer  involved  in  ISS  development  from  its  ineeption.  Mr.  Wineh’s 
involvement  with  the  ISS  began  in  1984  with  Boeing  proposal  work 
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development  of  the  then  U.S.  Spaee  Station.  In  1987  he  beeame  Deputy 
PM  for  Boeing’s  Spaee  Station  effort.  Boeing  had  been  awarded  a 
eontraet  for  one  of  three  major  work  paekage  eontraets  for  the  Station. 

In  1991  Mr.  Wineh  beeame  PM.  After  Boeing  was  seleeted  as  prime 
eontraetor  following  reorganization  and  internationalization  of  the 
program  in  1995,  Mr.  Wineh  eontinued  with  his  responsibilities  in 
Huntsville  for  aetivities  related  to  the  original  Boeing  work  paekage.  He 
retired  in  1997. 


1 .  Overview 

Figure  19  is  a  pieture  of  the  ISS  taken  in  April  of  2001.  This  image 
was  obtained  from  the  NASA  internet  Universal  Resouree  Loeator  (URL) 
address:  http: / / spaceflight.nasa.gov/ gallery /images /station /assembly /lores/ 
sl00e5970.jpg. 

The  U.S.  began  developing  what  is  now  the  ISS  in  the  early  1980s. 
Initial  efforts  were  disastrous  for  a  number  of  reasons  that  will  be 
diseussed  later.  However,  following  a  reorganization  of  the  effort  in  1995, 
a  drastie  reduetion  in  seope,  the  introduetion  of  international 
partieipation  and  heroie  efforts  on  the  part  of  many  people,  the  ISS  is 
now  in  spaee. 

The  International  Spaee  Station  is  the  largest  and  most 
eomplex  international  seientifie  projeet  in  history.  And  when 
it  is  eomplete  just  after  the  turn  of  the  eentury,  the  station 
will  represent  a  move  of  unpreeedented  seale  off  the  home 
planet.  Led  by  the  United  States,  the  International  Spaee 
Station  draws  upon  the  seientifie  and  teehnologieal 
resourees  of  16  nations:  Canada,  Japan,  Russia,  11  nations 
of  the  European  Spaee  Ageney  and  Brazil 
(http:  /  /www.shuttlepresskit.eom  /ISS_OVR  ). 
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Figure  19:  International  Space  Station  (from 
http:  /  /www.shuttlepresskit.com/ISS_OVR) 

Without  international  participation,  it  is  unlikely  that  the 

international  space  station  could  have  been  developed.  Each  participant 

has  had  and  continues  to  have  funding  difficulties  as  each  body  politic 

struggles  with  priorities.  Nations  pride,  and  a  deep-seated  human 

interest  in  space  keep  the  program  going.  Existing  or  planned  elements 

of  the  ISS  are  described  below. 

The  U.S.  elements  include  three  connecting  modules,  or 
nodes;  a  laboratory  module;  truss  segments;  four  solar 
arrays;  a  habitation  module;  three  mating  adapters;  a 
cupola;  an  unpressurized  logistics  carrier  and  a  centrifuge 
module.  The  various  systems  being  developed  by  the  U.S. 
include  thermal  control;  life  support;  guidance,  navigation 
and  control;  data  handling;  power  systems;  communications 
and  tracking;  ground  operations  facilities  and  launch-site 
processing  facilities. 
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The  international  partners,  Canada,  Japan,  the  European  Spaee 
Ageney,  and  Russia,  will  eontribute  the  following  key  elements  to  the 
International  Spaee  Station: 

•  Canada  is  providing  a  55-foot-long  robotie  arm  to  be  used 
for  assembly  and  maintenanee  tasks  on  the  Spaee  Station. 

•  The  European  Spaee  Ageney  is  building  a  pressurized 
laboratory  to  be  launehed  on  the  Spaee  Shuttle  and  logisties 
transport  vehieles  to  be  launehed  on  the  Ariane  5  launeh 
vehiele. 

•  Japan  is  building  a  laboratory  with  an  attaehed  exposed 
exterior  platform  for  experiments  as  well  as  logisties 
transport  vehieles. 

•  Russia  is  providing  two  researeh  modules;  an  early  living 
quarters  ealled  the  Serviee  Module  with  its  own  life  support 
and  habitation  systems;  a  seienee  power  platform  of  solar 
arrays  that  ean  supply  about  20  kilowatts  of  eleetrieal  power; 
logisties  transport  vehieles;  and  805012  spaeeeraft  for  erew 
return  and  transfer  (www.shuttlepresskit.eom/ISS_OVR). 

In  addition,  Brazil  and  Italy  are  eontributing  additional  equipment 
to  the  station,  ineluding  the  Italian  Logisties  Module  “Leonardo”  that 
reeently  gained  international  aeelaim. 


2.  Application  of  the  TMO  Framework 
a.  TMO  Considerations 

Table  15  eaptures  the  ISS  TMO  Consideration  elements. 
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Table  15:  ISS  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

The  ISS  organization  started  out  as  a  distributed  US  activity  that 
included  3  major  subsystem  developments,  with  no  central 
management  control.  This  was  disastrous  and  led  to  restructuring. 
The  new  structure  was  international,  including  the  U.S.,  Russia,  the 
European  Space  Agency,  Japan  and  others.  NASA  remains 
responsible  for  coordinating  operations,  however,  Boeing  is 
responsible  for  all  technical  coordination  and  control  of  the  major 
system  interfaces.  Each  partner  is  fully  responsible  for  detailed 
specifications,  funds,  designs  and  the  product  agreed  to. 
Internationally,  the  organization  is  loosely  coupled  with  partners 
having  distinct  and  clearly  defined  responsibilities  that  are  product 
oriented. 

2.  RDEC/ 
Contractor 
Technical 
Support 

Government  Lab /Contractor  Technical  Support  is  critical  to  the 

NASA  ISS  role  of  oversight,  management  of  technical  risk  and 
general  technology  support.  NASA  does  not  involve  foreign  support- 
contractors,  that  is  left  up  to  the  participating  partner  nations. 
Similarly,  the  foreign  partners  have  no  issue  with  support 
contractors  that  NASA  uses  to  provide  technical  support. 

3.  Management 
of  Technical 
Requirements 

NASA  sets  the  basic  requirements.  Boeing  maintains  the  day  to  day 
control  of  interfaces  went  through  Boeing.  Boeing  also  developed  a 
System  Specification  to  ensure  a  common  understanding  of  the 
system  requirements.  Lower  level  specifications,  such  as  for  the 
solar  panel  arrays  were  also  firmly  controlled.  International 
considerations  for  requirements  center  primarily  on  the  docking 
interfaces  and  the  interface  of  ISS  components  to  the  Space  Shuttle, 
for  those  components  to  be  transported  by  the  Space  Shuttle. 
Requirements  such  as  safety,  reliability,  strength,  vibration  and 
stiffness  were  suggested  to  partners  for  use  with  their  systems, 
however,  specification  responsibility  for  modules  developed  by 
partners  such  as  the  European  Space  Agency,  Russia  and  Japan 
rests  with  the  developing  partner. 

4.  Management 
of  Technical 

Risk 

Management  Technical  Risk  is  done  by  Boeing  and  independently 
by  the  partner  nations.  However,  NASA  maintains  oversight  of 
safety  and  reliability  for  all  elements  of  the  ISS.  During  the 

Mercury,  Jupiter  and  Apollo  space  programs,  NASA  achieved 
success  by  emphasizing  safety  and  reliability.  This  emphasis  was 
reduced  when  routine  Space  Shuttle  operations  began.  However, 
the  Space  Shuttle  Challenger  accident  was  a  reminder  to  NASA  that 
space  operations  are  inherently  dangerous.  Today,  safety  and 
reliability  are  key  foci  of  risk  management  for  NASA. 

5.  Technical 

Monitoring 

Capability 

NASA  technical  oversight  is  heavily  focused  on  safety  and  reliability. 
NASA  is  responsible  for  overseeing  the  contracts  it  lets  with  Boeing, 
however,  Boeing  is  pretty  free  to  act  within  the  bounds  of  the  ISS 
contracts.  All  participants  work  together  as  a  team.  This  is  possible 
because  of  the  pride  that  individuals  take  in  their  participation  in 
the  grand  adventure  of  space. 
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Table  15:  ISS  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

6.  Direct 
Technical 
Contribution 

Direct  Technical  Contributions  are  made  by  NASA  and  all 
participants  based  on  the  roles  they  play.  NASA  provides  facilities 
for  Testing  components,  launching  rockets  and  launching  the  Space 
Shuttle.  NASA  also  develops  candidate  technologies  and  processes 
that  may  be  used  on  the  ISS.  NASA  provides  the  services  of  experts 
when  needed  by  Boeing  and  the  other  participants.  Other 
Governments  participate  in  the  development  of  their  ISS 
components  as  they  see  fit.  All  participants  are  highly  motivated  to 
succeed. 

7.  Control  of 
and  Access  to 
Technical  Data 

The  policy  of  NASA  for  open  flow  of  information  relative  to  the  ISS 
includes  Government  generated  information  and  to  a  very  large 
extent,  there  is  no  proprietary  data  used  for  the  ISS.  Almost  all 
Government  and  contractor  information  is  freely  available  to  anyone 
with  a  legitimate  need  for  access. 

8.  User 
Participation 

The  concept  of  User  Participation  may  not  apply  to  development  of 
the  ISS,  because  there  is  no  entity  called  the  User  for  any  NASA 
development  activity.  NASA  both  develops  the  requirements  and 
then  executes  contracts  to  develop  the  system.  The  astronauts  are 
to  NASA  and  the  ISS  like  soldiers  are  to  the  Army  in  that  astronauts 
will  use  the  ISS.  They  influence  Human  System  Interface  (HSl) 
issues. 

9.  Cost  Share 
and  Work 

Share 

Cost  Share  and  Work  Share  is  not  an  issue  for  the  ISS.  Nations  pay 
for  the  ISS  components  they  are  responsible  to  produce.  There  is  no 
sharing  of  development  costs  in  that  sense.  Canada  paid  for  the 
development  of  the  ISS  robotic  arm.  Russia  paid  for  the  service 
module,  the  European  Union  is  paying  for  development  of  the 
European  Space  Agency’s  laboratory  and  Japan  is  paying  for 
development  of  its  laboratory. 

10.  Preparation 
of  Contract 

SOWS 

j.  There  are  no  special  international  considerations  for  the 
Preparation  of  Contract  Statements  of  Work  (SOW)  for  the  ISS. 

Each  participating  country  makes  its  own  arrangements  with  its 
industry  for  work  to  be  performed. 

b.  TMO  Program  Feedback  Considerations 

Table  16  captures  the  ISS  TMO  Program  Feedback  elements. 
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Table  16:  ISS  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1 .  International 
Executive 

Control 

There  is  no  international  executive  control  of  the  ISS  per  se.  NASA 
controls  development  of  the  ISS,  and  it  is  purely  through  good  will 
and  common  interest  that  enables  international  participation. 

2.  TMO 

Funding 

TMO  Funding  is  split  off  of  the  overall  program  funds  to  support 
NASA  oversight  of  Boeing  and  the  international  partners  efforts. 
Safety  and  reliability  are  important  focus  areas  for  NASA  and  thus 
receive  a  good  portion  of  the  NASA  TMO  funds. 

3.  National 
Interaction 

Related  to  TMO,  this  involves  primarily  reliability  and  safety.  Most 
of  the  details  of  specification  and  design  that  are  of  interest  to  the 
U.S.  are  delegated  to  Boeing. 

4.  US 

Acquisition 
Review  prior  to 
next  phase 

U.S.  Acquisition  Review  Prior  to  the  Next  Program  Phase  does  not 
apply  to  the  ISS. 

3.  Elaboration 

a.  ISS  TMO  International  Organizational  Aspects 

The  original  Space  Station  began  in  the  mid  1980s  almost 
exclusively  as  a  U.S.  program.  The  original  program  was  a  disaster  that 
resulted  from  inappropriate  program  structure  and  unaffordable 
requirements  that  constantly  changed.  Initially  the  program  was  set  up 
as  a  U.S.  program  with  three  major  work  packages.  NASA’s  Lewis  Center 
in  Cleveland,  Ohio  managed  a  contract  with  Rockwell’s  Rocketdyne 
Division.  NASA’s  Johnson  Center  in  Houston,  Texas  managed  a  contract 
with  McDonald  Douglas  and  NASA’s  Marshal  Center  in  Huntsville, 
Alabama  managed  a  contract  with  Boeing.  The  effort  was  supposed  to  be 
integrated  and  coordinated  from  NASA  facilities  in  Reston,  VA,  who  used 
Grumman  for  a  support  contractor.  The  only  problem  was,  the  Reston 
activity  had  no  control.  This  was  a  recipe  for  confusion.  This  was  a 
recipe  for  disaster.  Spiraling  costs  and  a  growing  sense  that  the  program 
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was  out  of  control  led  to  restructuring  of  the  program  and 
internationalization  of  the  program. 

In  1995  Boeing  was  given  the  Prime  Contract  for  the 
reorganized  International  Space  Station.  Boeing  was  expected  to 
rationalize  the  program,  identify  a  set  of  achievable  requirements, 
establish  control  of  the  interfaces,  coordinate  with  international  partners, 
and  make  this  all  happen  with  the  yearly  fluctuating  budget  provided  by 
congress.  NASA  remained  in  nominal  overall  control,  establishing  the 
contract  requirements  with  Boeing.  However,  no  central  international 
coordinating  body  was  established  between  Governments. 

Next  to  the  United  States,  the  most  prominent  international 
participant  in  the  ISS  development  was  Russia.  Bringing  the  Russians 
into  the  activity  seemed  purely  political,  at  the  time.  However,  they 
brought  a  lot  of  knowledge  and  ability  to  the  program.  There  were  good 
working  relationships  between  the  Russians  and  the  Americans.  The 
main  difficulty  that  emerged  was  the  difficulty  Russia  had  in  meeting  its 
commitments  to  deliver  hardware.  This  was  a  funding  issue,  however, 
and  not  an  organizational  issue. 

After  Russia,  the  most  visible  participants  in  ISS 
development  are  the  Germans,  Italians  and  Japanese.  They  have  shown 
a  strong  desire  to  participate  actively,  and  they  are  very  capable.  The 
Italians  developed  the  pressurized  logistics  module  that  can  be 
transported  via  the  space  shuttle  and  re-used,  and  this  has  already 
played  an  important  role  in  outfitting  the  ISS  and  making  the  ISS 
habitable. 

Organizationally,  all  who  participate  in  the  ISS  development 
are  members  of  a  team  with  clearly  established  responsibilities.  NASA 
maintains  a  contract  with  Boeing  that  has  a  Statement  Of  Work  (SOW) 
flexible  enough  to  adjust  according  to  annual  funding.  Portions  of  the 
ISS  are  developed  by  Boeing  and  subcontractors.  The  international 


85 


partners  independently  manage  development  of  any  ISS  modules  they 
have  agreed  to  develop.  NASA’s  role  in  the  exeeution  is  eontraet 
oversight,  providing  launeh  and  test  faeilities,  teehnieal  eonsultation  for 
materials  and  proeesses,  and  oversight  of  teehnieal  risk.  The  team  works 
beeause  everyone  knows  their  role  and  everyone  wants  to  sueeeed. 

b.  Discussion:  ISS  Management  of  Requirements 

Initially  the  intended  use  of  the  Spaee  Station  was  poorly 
defined,  but  it  was  required  to  be  everything  to  everybody.  This  proved  to 
be  to  mueh  to  aeeomplish  and  too  expensive.  So  it  had  to  be  sealed  baek 
eontinuously  over  the  years.  There  was  eutbaek  after  eutbaek  after 
eutbaek.  After  Boeing  was  made  prime  eontraetor  for  the  entire  projeet, 
the  situation  improved. 

In  terms  of  fundamental  requirements,  NASA  still  sets  the 
basie  requirements.  However,  following  seleetion  of  Boeing  as  the  prime 
eontraetor,  the  day  to  day  eontrol  of  interfaees  went  through  Boeing. 

And,  although  not  required  to,  Boeing  developed  a  System  Speeifieation 
to  ensure  a  eommon  understanding  of  the  system  requirements.  Lower 
level  speeifieations,  sueh  as  for  the  solar  panel  arrays  were  also  firmly 
eontrolled. 

International  eonsiderations  for  requirements  eentered 
primarily  on  the  doeking  interfaees  and  the  interfaee  of  ISS  eomponents 
to  the  Spaee  Shuttle,  for  those  eomponents  to  be  transported  by  the 
Spaee  Shuttle.  Requirements  sueh  as  safety,  reliability,  strength, 
vibration  and  stiffness  were  suggested  to  partners  for  use  with  their 
systems,  however,  speeifieation  responsibility  for  modules  developed  by 
partners  sueh  as  the  European  Spaee  Ageney,  Russia  and  Japan  rests 
with  the  developing  partner.  Boeing  maintains  eontrol  of  the  doeking 
interfaee  and  the  interfaee  of  ISS  eomponents  to  the  Spaee  Shuttle.  To 
ensure  absolute  adherenee  to  the  doeking  interfaee,  Boeing  provides  the 
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actual  docking  interface  hardware  to  the  partner  nation  for  use  on  the 
aetual  ISS  module.  The  partner  then  must  integrate  (weld)  the  doeking 
interfaee  into  the  ISS  module  being  developed. 

c.  Discussion:  Control  of  and  Access  to  Technical  Data 

Control  of  and  aeeess  to  teehnieal  data  is  different  for 
development  of  the  ISS  than  for  development  of  military  systems.  The 
effeetiveness  of  military  systems  sometimes  depends  a  great  deal  on 
depriving  the  adversary  of  teehnieal  details  about  the  system.  A  military 
system  is  potentially  more  vulnerable  if  an  adversary  knows  how  the 
system  works  and  its  weaknesses.  The  ISS,  and  other  NASA  systems,  on 
the  other  hand  are  not  military  systems  and  are  not  been  developed  with 
the  idea  of  having  to  survive  an  attaek.  NASA  does  not  withhold 
information.  NASA  has  a  poliey  of  openness  that  is  sometimes  elose  to 
being  in  eonfliet  with  the  State  Department  export  polieies. 

Sometimes  export  polieies  of  the  U.S.  have  been  eause  for 
Boeing  to  avoid  direet  transmittal  of  data  to  eompanies  in  other 
eountries.  Often,  NASA  has  aeted  as  the  intermediary  to  enable  the 
transmittal  of  eritieal  teehnieal  information. 

F.  MULTIPLE  LAUNCH  ROCKET  SYSTEM  (MLRS)  TERMINAL  GUIDED 
WARHEAD  (TGW) 

Information  for  this  diseussion  is  primarily  from  an  interview  with 
Mr.  Dennis  Vaughn,  who  was  worked  on  the  MLRS  program  for  8  years 
as  the  Division  Chief  for  Produet  Assuranee  and  Test  (PA&T)  and  then  for 
12  years  as  the  MLRS  Deputy  Program  Manager  (DPM).  While  PA&T 
Division  Chief  Mr.  Vaughn  was  also  ehairman  of  the  MLRS  multinational 
test  working  group. 

For  the  purpose  of  diseussing  TMO,  this  seetion  foeuses  on  the 
MLRS  TGW  warhead  development.  However,  some  eomments  are 
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directed  at  the  overall  MLRS  program  for  context  or  as  information  that 
may  be  of  value. 


1 .  Overview 

Figure  20  is  an  image  of  an  MLRS  rocket  being  fired  from  an  M270 
rocket  launcher. 


Figure  20:  MLRS  Rocket  Firing  (from 


http:  /  /www.redstone. army.mil/history/systems/MLRS.html) 

The  Multiple  Launch  Rocket  System  (MLRS),  formerly  known 
as  the  General  Support  Rocket  System  (GSRS),  is  designed 
to  supplement  cannon  weapons  available  to  U.S.  Army 
division  and  corps  commanders  for  the  delivery  of  a  large 
volume  of  firepower  in  a  very  short  time  against  critical, 
time-sensitive  targets.  MLRS  is  a  free-flight  artillery  rocket 
system  that  greatly  improves  the  conventional,  indirect  fire 
capability  of  the  field  Army.  The  system  provides  counter¬ 
battery  fire  and  suppression  of  enemy  air  defenses,  light 
materiel,  and  personnel  targets. 


23  Jul  80  The  governments  of  the  United  States,  the  United 
Kingdom,  Germany,  and  France  signed  a  formal  declaration 
of  intent  to  participate  in  the  concept  definition  phase  of  the 
terminal  guidance  warhead  (TGW)  program  [for  use  with 
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MLRS] .  The  primary  mission  of  the  TGW  would  be  to  provide 
rapid  fire,  non-nuelear  eapability  to  destroy  a  wide  speetrum 
of  stationary  and  moving,  medium  hard  to  very  hard, 
armored  targets.  The  deelaration  required  that  the  TGW  be 
jointly  developed,  with  aetive  partieipation  by  industries  of 
all  four  nations 

(http:  /  /  WWW. redstone.army.mil/ history/  systems/ 

MLRS.html). 

TGW  was  intended  to  be  an  autonomous  seeking  warhead  for  use 
with  the  MLRS  roeket.  However,  TGW  development  ended  following 
sueeessful  test  dispense  from  an  in-flight  MLRS  missile.  The  program 
was  terminated  prior  to  system  maturation  and  produetion. 


2.  Application  of  the  TMO  Framework 
a.  TMO  Considerations 

Table  17  eaptures  the  TMO  Consideration  elements  for 

MLRS  TGW. 


Table  17:  MLRS  TGW  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1.  TMO 

Organizational 

Aspects 

The  TGW  effort  was  a  U.S.  led  co-development  effort  involving  shared 
responsibility  within  the  Program  Office  from  the  participating 
nations:  the  United  Kingdom  (UK),  Germany  (GE),  France  (FR)  and 
the  United  States  (US).  The  TGW  product  office  consisted  of 

Associate  Product  Managers  (APMs)  from  each  participating  nation, 
with  technical  staff  including  engineering,  test  and  logistics 
personnel  from  each  participating  nation.  The  APMs  all  reported  to 
the  PM  for  MLRS,  who  was  a  US  Colonel.  Each  participating 
country  maintained  an  MLRS  Program  Office  for  internal  national 
coordination.  The  MLRS  TGW  Executive  Management  Committee 
consisting  of  the  National  PMs  for  MLRS  and  the  Training  and 

Doctrine  Command  (TRADOC)  System  Manager  or  his  equivalent 

User  representative  was  the  primary  international  coordinating  body 
for  MLRS  TGW.  The  Executive  Management  Committee  was  chaired 
by  the  U.S.  PM  for  MLRS,  although  each  member  was  of  equal  status 
for  decision  making.  In  turn,  the  Management  Executive  Committee 
reported  to  the  MLRS  Joint  Steering  Committee,  which  was  a  two- 
star  board  of  directors  providing  international  executive  oversight 
over  the  MLRS  TGW  program. 
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Table  17:  MLRS  TGW  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

2.  RDEC/ 
Contractor 
Technical 
Support 

Technical  Support  was  critical  to  the  conduct  of  the  MLRS  TGW 
development  effort.  The  key  to  enabling  this  support  was  an  activity 
in  the  MLRS  program  office  to  manage  overall  cost  share  and  work 
share.  This  allowed  the  PM  MLRS  flexibility  to  arrange  for  technical 
support  from  a  variety  of  sources. 

3. 

Management 
of  Technical 
Requirements 

Establishing  the  initial  requirements  for  MLRS  TGW  was  difficult  and 
required  a  great  deal  of  time.  Agreeing  to  targets  for  the  system  was 
the  biggest  difficulty.  Once  the  initial  requirements  were  set  liaison  , 
the  management  of  change  to  specifications  was  managed  through 
each  nations  Associate  Product  Managers,  who  understood  the  type 
of  changes  that  could  be  agreed  and  those  that  would  require 
extensive  international  coordination. 

4. 

Management 
of  Technical 

Risk 

Management  of  Technical  Risk  involved  periodic 
cost /schedule /technical  risk  assessments.  In  some  cases, 
competing  designs  were  carried  forward  to  selected  decision  points. 
Day  to  day  activities  in  Huntsville  involved  technical  reviews  and 
interchanges  with  the  prime  contractor  and  major  subcontractors. 

The  APMs  for  each  country  went  through  the  program  from  top  to 
bottom  on  behalf  of  their  nation  to  provide  feedback  to  their  national 
PM  regarding  significant  technical  risk.  Millimeter  Wave  technology 
was  a  major  risk  for  TGW.  The  basic  millimeter  wave  technology  was 
brought  in  by  Germany.  The  LfS  brought  in  IR  technology  which  also 
contained  significant  risk. 

5.  Technical 

Monitoring 

Capability 

Technical  Monitoring  Capability  was  divided  between  RDEC,  labs 
within  other  nations,  and  contract  support.  For  technical  oversight 
involving  test,  there  was  a  good  degree  of  involvement  from  all 
participating  nations. 

6.  Direct 
Technical 
Contribution 

Engineers,  testers,  and  logisticians  from  the  MLRS  Program  Office 
made  Direct  Technical  Contributions.  The  LfS  unique  contributions 
were  related  to  requirements,  the  selection  of  targets  and  system 
evaluation.  The  US  unique  activities  were  essential  to  establishing 
the  US  position  for  requirements  discussions  and  definitions  of 

SOWs.  In  general,  all  parties  brought  competent  and  aggressive 
technical  talent  to  TGW.  The  difficult  part  of  this  was  the  time 
required  to  address  everyone’s  concerns.  The  value  of  having  smart 
people  doing  TMO  is  identification  of  problems  that  might  not 
otherwise  be  found.  The  difficulty  is  that  some  of  the  problems 
found  are  not  problems.  Addressing  them  takes  time  and  energy 
away  from  solving  the  real  problems. 

7.  Control  of 
and  Access  to 
Technical  Data 

For  MLRS,  the  participating  nations  all  brought  valuable 
information  into  the  program,  and  technology  transfer  of  sensitive 

U.S.  technology  did  not  become  an  insurmountable  problem.  Two 
specific  difficulties:  (1)  Establishing  access  in  U.S.  contractor 
facilities  for  non-U. S.  people.  (2)  Establishing  a  process  for 
transmitting  electronically  or  through  the  mail  classified  and 
sensitive  programmatic  and  design  information. 
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Table  17:  MLRS  TGW  TMO  Considerations  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

8.  User 
Participation 

User  Participation  was  critical  for  MLRS  in  general  and  for  TGW, 
particularly  for  establishing  the  basic  TGW  system  requirements  and 
target  characteristics.  Each  country  was  represented  on  the  TGW 
Executive  Management  Committee  by  the  country  PM  and  TSM  level 
User  representative.  This  solid  connection  to  the  user  communities 
enabled  difficult  issues  to  be  addressed  relatively  quickly. 

One  issue  revolved  around  facilities  for  depot  maintenance. 

Common  logistics  support  was  established  for  MLRS  in  Europe.  This 
worked  well  for  the  US  due  to  the  heavy  US  presence  in  Germany. 
However,  for  the  US  to  use  the  European  repair  facility,  effective 
configuration  control  of  components  was  essential.  The  approach 
proved  effective.  During  Desert  Storm,  the  US  and  European  units 
were  able  to  use  the  same  spare  parts. 

9.  Cost  Share 
and  Work 

Share 

Cost  Share  and  Work  Share  portions  for  TGW  were  agreed  upon  in 
the  TGW  MOU.  They  were  US:  40%;  GE:  20%;  FR:  20%;  UK:  20%. 

For  cost  share,  the  national  currencies  were  “Pegged”  at  some  initial 
equivalence,  and  then  this  equivalence  was  used  throughout  the 

TGW  activity.  Work  share  was  more  difficult  to  manage,  because 
expertise  was  not  evenly  distributed  and  companies  were  cautious 
about  revealing  their  trade  secrets.  Additionally,  distributing  work 
geographically  incurred  penalties  because  of  distance  and  the 
difficulty  in  communicating  over  long  distances. 

The  prime  contractor,  an  international  consortium,  was  responsible 
for  managing  work  share  for  the  contracted  effort.  PM  MLRS  was 
responsible  for  managing  overall  work  share.  It  was  recognized  early 
that  work  share  would  not  always  be  in  balance.  A  work  share 
problem  from  one  development  phase  could  be  addressed  in  the  next. 
Ultimately,  imbalances  remaining  once  production  began  could  be 
addressed  by  adjustments  to  third  party  sales.  Duplicate  MLRS 
production  lines  had  been  set  up  in  the  U.S.  and  in  Europe. 

10. 

Preparation  of 
Contract 

SOWS 

Discussion:  Preparation  of  Contract  Statements  of  Work  (SOW)  was 
time  consuming  and  required  great  effort  on  the  part  of  all 
participants.  The  TGW  SOWs  were  of  great  interest  to  each  national 
PM,  and  obtaining  agreement  for  the  content  of  the  SOWs  at  the 
National  PM  level  was  essential,  although  laborious. 

b.  TMO  Program  Feedback  Considerations 

Table  18  captures  the  TMO  Program  Feedback  elements  for 
the  MLRS  TGW  program. 
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Table  18:  MLRS  TGW  TMO  Program  Feedback  Framework  Elements 


TMO 

Consideration 

Interview/ Assessment 

1. 

International 

Executive 

Control 

The  Joint  Steering  Committee  did  not  get  directly  involved  in  the  day 
to  day  decisions  and  coordination  that  was  necessary  between 
nations.  This  coordination  was  performed  by  the  TGW  Executive 
Management  Committee.  When  issues  arose  that  the  executive 
management  committee  was  not  empowered  to  address,  they  were 
raised  to  the  level  of  the  Joint  Steering  Committee. 

2.  TMO 

Funding 

b.  TMO  Funding  was  managed  by  the  PM  within  the  context  of  Cost 
Share  and  Work  Share.  The  main  thing  was  to  balance  the  overall 
work  share  in  line  with  cost  share,  however,  and  TMO  was  only  one 
element  considered  when  balancing  cost  share  and  work  share. 

Some  funding  was  allocated  by  PM  MLRS  for  US  unique  activity 
which  was  accounted  for  and  managed  separately. 

3.  National 
Interaction 

National  Interaction  with  the  US  bureaucracy  involved  dealing  with 
people  who  were  detractors  and  those  who  were  proponents. 

Generally  the  detractors  have  difficulty  dealing  with  international 
programs  because  they  fall  outside  of  establish  procedures  for 
security  and  accountability.  With  TGW,  people  in  the  US  acquisition 
process  had  not  yet  become  accustomed  to  working  with 
international  programs. 

“Decision  makers  in  the  US  cannot  go  to  the  PM  and  demand 
something  in  particular.  The  US  PM  has  to  go  to  the  international 
program  partners  and  consult.  Sometimes  the  US  decision  makers 
are  looking  for  a  direct  answer  (Dennis  Vaughn  Interview,  16  August 
2001).” 

4.  US 
Acquisition 
Review  prior  to 
next  phase 

The  U.S.  acquisition  review  process  was  essentially  the  same  for 

MLRS  as  for  other  U.S.  acquisition  programs.  The  difference  was 
that  an  attempt  was  made  to  minimize  the  duplication  of 
documentation  needed  by  each  country’s  acquisition  process.  For 
example,  the  Test  and  Evaluation  Master  Plan  (TEMP)  was  expanded 
to  include  consideration  for  European  testing  and  the  needs  of  GE, 

FR  and  UK  decision  makers.  The  Acquisition  Strategy  document 
required  by  the  U.S.  acquisition  process,  was  too  different  than  what 
was  needed  by  the  European  acquisition  processes.  Excerpts  from 
the  US  document  were  used  to  satisfy  European  acquisition  needs, 
however,  the  US  document  was  maintained  separately. 

3.  Elaboration 

a.  TMO  International  Organizational  Aspects 

The  TGW  development  effort  was  eondueted  within  the 
framework  of  the  existing  MLRS  program  strueture.  A  separate  MOU 
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was  created  for  TGW,  however  this  MOU  was  written  to  be  eonsistent 
with  the  basie  MLRS  MOU.  The  MLRS  international  relationships  are 
depieted  in  Figure  21. 

The  TGW  effort  was 
a  eo-development  effort 
involving  shared  responsibility 
within  the  Program  Offiee  from 
the  partieipating  nations:  the 
United  Kingdom  (UK),  Germany 
(GE),  Franee  (FR)  and  the 
United  States  (US).  The  TGW 
produet  offiee  eonsisted  of 
Assoeiate  Produet  Managers 
(APMs)  from  eaeh  partieipating 
nation,  with  teehnieal  staff 
ineluding  engineering,  test  and 
logisties  personnel  from  eaeh  partieipating  nation.  The  APMs  all  reported 
to  the  PM  for  MLRS,  who  was  a  US  Colonel.  Eaeh  partieipating  eountry 
maintained  an  MLRS  Program  Offiee  for  internal  national  eoordination. 
The  MLRS  TGW  Exeeutive  Management  Committee  eonsisting  of  the 
National  PMs  for  MLRS  and  the  Training  and  Doetrine  Command 
(TRADOC)  System  Manager  or  his  equivalent  User  representative  was  the 
primary  international  eoordinating  body  for  MLRS  TGW.  The 
Management  Exeeutive  Committee  was  ehaired  by  the  U.S.  PM  for  MLRS, 
although  eaeh  member  was  eonsidered  of  equal  status  for  deeision 
making.  In  turn,  the  Management  Exeeutive  Committee  reported  to  the 
MLRS  Joint  Steering  Committee,  whieh  was  a  two-star  board  of  direetors 
providing  international  exeeutive  oversight  over  the  MLRS  TGW  program. 


Figure  21:  MLRS  Management  (from 
interview  with  Dennis  Vaughn) 
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b.  Discussion:  RDEC/Contractor  Technical  Support 

RDEC /  Contractor  technical  support  was  critical  to  the 
sueeess  of  TGW  development.  Not  the  least  of  this  teehnieal  support 
provided  by  RDEC  involved  a  Hardware  In  the  Loop  (HWIL)  faeility  that 
was  used  by  both  the  developing  eontraetor  and  the  MLRS  Program 
Offiee.  Teehnieal  support  eame  in  two  flavors  for  MLRS  TGW.  There  was 
teehnieal  support  paid  for  solely  by  the  U.S.,  and  there  was  teehnieal 
support  subjeet  to  eost  share  and  work  share.  PM  MLRS  had  authority 
to  establish  TGW  support  aetivities,  with  the  eaveat  that  the  overall  work 
share  was  supposed  to  remain  balaneed  for  support  that  applied  to 
partner  nations.  Surveys  were  made  to  find  potential  sourees  for  support 
in  the  partieipating  nations.  The  goal  was  to  give  eaeh  eountry  a  fair 
share  based  on  the  overall  MOU  eost  share/ work  share  agreement. 
However,  there  was  no  speeial  eost  share / work  share  pool  that  had  to  be 
balaneed  for  eontraet  teehnieal  support.  The  requirement  was  to  balanee 
the  overall  eost  share/ work  share  for  TGW.  It  was  reeognized  early  on  in 
MLRS  that  the  PM  needed  to  have  the  authority  to  make  deeisions,  ... 
and  he  did  make  deeisions.  Many  times  there  were  sessions  of  the  MLRS 
Exeeutive  Management  Committee  to  debate  and  ratify  these  deeisions. 
National  interests  were  involved,  but  it  was  also  reeognized  that  the 
program  needed  to  move  forward  and  that  eompromise  was  neeessary. 

c.  Discussion:  Management  of  Technical  Requirements 

Management  of  teehnieal  requirements  for  TGW  was  diffieult 
in  terms  of  establishing  the  initial  TGW  requirement.  Mueh  of  the 
diffieulty  eentered  around  target  seleetion  and  eharaeterization  of  the 
target  seleeted.  This,  in  turn,  led  to  diffieulty  in  the  seleetion  of  the 
teehnology  to  use.  TGW  was  an  autonomously  guided  warhead  that 
relied  upon  the  target’s  fundamental  physieal  eharaeteristies  for  terminal 
guidanee. 
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Each  nation’s  Users  were  aetively  involved  in  establishing 

the  basie  requirements,  and  eaeh  used  similar  proeesses. 

When  you  really  get  down  to  the  details,  eaeh  of  the  nations 
goes  through  the  same  proeess  to  arrive  at  a  system.  The 
users  define  the  need,  negotiate  with  the  developers  on  what 
is  aehievable  to  arrive  at  a  system  requirement,  no  matter 
what  name  you  eall  it.  (Dennis  Vaughn  Interview,  16  August 
2001) 


For  managing  the  requirements,  the  TGW  Exeeutive 
Management  Committee  addressed  the  top  level  requirements  at  a  level 
that  would  be  similar  to  the  US  ORD  level.  A  system  speeifieation  was 
published  to  refieet  the  eommon  requirements  of  the  Users  from  UK,  GE, 
FR  and  US.  Any  ehanges  to  this  system  speeifieation  required  agreement 
by  the  TGW  Exeeutive  Management  Committee. 

Requirements  alloeated  to  lower  level  speeifieations  were 

generally  addressed  within  the  MLRS  Program  Offiee  by  national  APMs  or 

engineers  who  were  expeeted  to  speak  for  their  eountries,  and  they  were 

expeeted  to  know  when  to  eoordinate  with  their  National  PMs.  Eleetronie 

Configuration  Management  (CM)  was  used.  Loeal  people  in  the 

Huntsville  MLRS  Program  Offiee  sat  on  the  TGW  CM  board. 

It  ran  pretty  smoothly.  There  were  hard  arguments  for  hard 
issues,  but,  things  ran  pretty  smoothly  (Dennis  Vaugh 
Interview,  16  August  2001). 


d.  Discussion:  Technical  Monitoring  Capability 

Teehnieal  monitoring  eapability  was  divided  between  RDEC, 
labs  within  other  nations,  and  eontraet  support.  For  teehnieal  oversight 
involving  test,  there  was  a  good  degree  of  involvement  from  all 
partieipating  nations. 

There  was  a  degree  of  eompetition  between  test  ranges  in  the 
different  partner  nations.  Where  was  the  most  effeetive  plaee 
to  do  this  testing?  Everything  from  eomponent  and 
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environmental  testing  to  flight  testing.  The  first  faetor 
eonsidered  was  ‘How  effeetive  would  the  test  faeility  be?’  The 
seeond  faetor  eonsidered  was  work  share.  Components,  test 
equipment,  analysis,  ...  these  things  were  spread  around. 
And  then  there  was  the  ordnanee  board  and  the  safety  board 
(Dennis  Vaughn  Interview,  16  August  2001). 


e.  Discussion:  Control  of  and  Access  to  Technical  Data 

Control  of  and  aeeess  to  teehnieal  data  was  an  important 
diffieulty  to  overeome.  Coneern  for  eontrol  of  information  exehanged 
between  eontraetors  and  between  Governments  is  less  in  Europe  than  in 
the  US,  beeause  European  nations  are  more  aeeustomed  to  eooperative 
development  effort. 

Visa/Working/Seeurity  arrangements  at  the  start  were  very 
diffieult.  Trying  to  set  up  in  the  industry  for  foreign 
nationals  to  eome  to  Orlando  or  Dallas  and  have  the  freedom 
to  eome  and  go  and  to  open  a  file  eabinet  took,  ...  in  some 
eases  ,  a  long  time.  There  are  a  lot  of  rules  in  the  US  that 
are  not  geared  for  multinational  programs.  ...  Or,  it  was  a 
problem  if  someone  eritieal  to  the  program  had  a  visa  run 
out  and  he  had  to  go  baek  to  Europe(Dennis  Vaughn 
Interview,  16  August  2001). 

Seeure  eommunieations  between  PMs  and  partieularly 

between  national  PMs  in  the  US  and  eounterparts  was  diffieult.  To  solve 

that  problem,  seeurity  equipment  was  sent  to  the  other  offiees  just  get 

past  the  eompatibility  issues.  Flow  of  information  in  general  was 

diffieult.  A  speeial  offiee  was  set  up  within  the  MLRS  Program  Offiee  to 

handle  the  exehange  of  information  between  eountries. 

We  had  a  eentral  offiee  in  the  PM  shop  that  all  information  flowed 
through.  We  were  able  to  use  diplomatie  earners  and  individuals 
within  eaeh  eontraetor  that  were  designated  earners.  There  were 
eouriers  between  eaeh  eountry.  For  any  US  information  to  be 
exehanged,  it  had  to  eome  in  through  seeurity  ehannels,  with  proper 
approval  (Dennis  Vaughn  Interview,  16  August  2001). 
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/.  Discussion:  Cost  Share  and  Work  Share 

Cost  share  and  work  share  portions  for  TGW  were  agreed 
upon  in  the  TGW  MOU.  They  were  US:  40%;  GE:  20%;  FR:  20%;  UK: 

20%.  For  eost  share,  the  national  eurreneies  were  “Pegged”  at  some 
initial  equivalenee,  and  then  this  equivalenee  was  used  throughout  the 
TGW  aetivity.  The  exehange  rate  was  fixed  for  TGW.  Although  several 
attempts  were  made  to  ehange  the  rates,  no  ehange  was  made  while  the 
program  was  aetive. 

Work  share  was  more  diffieult  to  manage,  beeause  expertise 
was  not  evenly  distributed  and  eompanies  were  eautious  about  revealing 
their  trade  seerets.  Additionally,  distributing  work  geographieally 
ineurred  penalties  beeause  of  distanee  and  the  diffieulty  in 
eommunieating  over  long  distanees. 

The  prime  eontraetor,  an  international  eonsortium,  was 

responsible  for  managing  work  share  for  the  eontraeted  effort.  PM  MLRS 

was  responsible  for  managing  overall  work  share.  It  was  reeognized  early 

that  work  share  would  not  always  be  in  balanee.  A  work  share  problem 

from  one  development  phase  eould  be  addressed  in  the  next.  Ultimately, 

imbalanees  remaining  onee  produetion  began  eould  be  addressed  by 

adjustments  to  third  party  sales.  Duplieate  MLRS  produetion  lines  had 

been  set  up  in  the  U.S.  and  in  Europe. 

All  during  the  program  we  tried  to  balanee  the  work. 

Sometimes  it  may  not  have  been  the  best  teehnieal  loeation 
to  do  the  work  (from  the  U.S.  perspeetive),  but  if  Germany 
was  down  in  work  share,  then  work  might  be  sent  to  labs  in 
Germany  (Dennis  Vaughn  Interview,  16  August  2001). 

Conversion  of  eurreneies  for  payment  of  program  aetivities 
was  minimized  by  establishing  a  bank  in  eaeh  eountry  for  the  payment  of 
eontraetor  effort  in  that  eountry.  The  PM  MLRS  maintained  reeords  of 
work  performed  and  issued  payment  vouehers  to  the  appropriate  banks 
for  work  performed  in  FR,  GE,  UK  or  US. 
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As  a  side  note,  a  follow-on  MLRS  program  ealled  Guided 
MLRS  (GMLRS),  does  not  impose  an  absolute  work  share  on  the  partner 
nations.  It  is  primarily  a  best  value  effort.  However,  GMLRS  is  a 
signifieantly  lower  eost  development  than  was  TGW.  It  is  not  eertain 
what  motivated  the  other  partners  to  agree  to  this  best  value  approaeh. 
Certainly  the  desire  for  the  eapability  was  a  faetor.  The  desire  to  simplify 
management  of  the  effort  and  to  reduee  eosts  may  have  also  been  faetors. 


g.  Discussion:  Preparation  of  Contract  Statements  of 
Work  (SOW) 

Preparation  of  Contraet  Statements  of  Work  (SOW)  was  time 

eonsuming  and  required  great  effort  on  the  part  of  all  partieipants.  The 

TGW  SOWs  were  of  great  interest  to  eaeh  national  PM,  and  obtaining 

agreement  for  the  eontent  of  the  SOWs  at  the  National  PM  level  was 

essential,  although  laborious. 

The  requirements  and  the  SOW  have  to  go  through 
individual  nation’s  deeision  proeesses.  The  budget  years 
don’t  line  up.  Timing  of  the  deeision  proeesses  don’t  always 
line  up.  There  just  was  a  lot  of  work  and  patienee  required 
to  pound  through  the  arguments.  It  goes  through  all  of  the 
funetional  diseiplines,  a  laborious  proeess.  It  also  requires 
leadership  in  these  working  groups  and  the  branehes  and  so 
forth  that  ean  deal  with  eompromises  (Dennis  Vaughn 
Interview,  16  August  2001). 


h.  Discussion:  National  Interaction 

National  interaetion  with  the  US  bureaueraey  involved 
dealing  with  people  who  were  detraetors  and  those  who  were  proponents. 
Generally  the  detraetors  have  diffieulty  dealing  with  international 
programs  beeause  they  fall  outside  of  establish  proeedures  for  seeurity 
and  aeeountability.  With  TGW,  people  in  the  US  aequisition  proeess  had 
not  yet  beeome  aeeustomed  to  working  with  international  programs. 


98 


Decision  makers  in  the  US  cannot  go  to  the  PM  and  demand 
something  in  particular.  The  US  PM  has  to  go  to  the 
international  program  partners  and  consult.  Sometimes  the 
US  decision  makers  are  looking  for  a  direct  answer  (Dennis 
Vaughn  Interview,  16  August  2001). 
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V.  ANALYSIS,  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  OVERALL  ANALYSIS,  CONCLUSIONS  AND  RECOMMENDATIONS 

The  framework  depieted  in  figure  22  has  been  used  to  organize 
information  gathered  during  interviews  with  senior  teehnieal  leaders 
from  high  profile  international  programs.  This  seetion  summarizes  the 
analysis,  presents  eonelusions  and  makes  reeommendations. 


Figure  22:  International  Technical  Management  Oversight 

Framework 


1 .  Overall  Analysis  and  Conclusion  for  Framework  Utility 

The  TMO  framework  was  effeetive  in  strueturing  data  eolleetion  for 
TMO  data  eolleetion  and  study  of  international  programs.  The  TMO 
framework  elements  were  found  to  have  various  degrees  of  utility.  A 
eriterion  ealled  “eoupling,”  emerged  from  the  analysis,  that  eorrelates  to 
the  utility  of  some  framework  elements  for  partieular  programs.  Tight 

eoupling  exists  for  a  program  if  signifieant  international  eoordination  is 
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required  for  program  exeeution.  This  situation  existed  for  the  MEADS 
and  the  MLRS  TGW  programs.  Loose  eoupling  exists  for  a  program  if 
minimal  international  eoordination  is  required.  This  framework  for 
evaluation  of  international  programs  is  most  effeetive  for  tightly  eoupled 
international  programs. 

Figure  23  depiets  the  eomposite  utility  of  eaeh  TMO  framework 
element  assessed.  The  detailed  assessments  for  eaeh  framework  element 
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TMO  Framework  Element  Key 


a.  TMO  Organizational  Aspeets 

b.  RDEC/Contraetor  TeehSupport 

e.  Management  of  Teeh  Rqmts 

d.  Management  of  Teehnieal  Risk 

e.  Teehnieal  Monitoring  Capability 

f.  Direet  Teehnieal  Contribution 

g.  Control/ Aeeess  to  Teehnieal  Data 


h.  User  Partieipation 

i.  Cost  Share  and  Work  Share 

j.  Preparation  of  Contraet  SOWs 

k.  International  Exee  Control 

l.  TMO  Funding 

m.  National  Interaetion 

n.  U.S.  Aequisition  Review 


Figure  23:  TMO  Framework  Element  Utility 


ean  be  found  in  seetion  B  of  this  chapter.  As  suggested  by  Figure  V  -  2, 
“TMO  Organizational  Aspects”  is  universally  applicable.  That  is  because 
the  organization  description  characterizes  each  program  as  tightly 
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coupled  or  loosely  eoupled,  whieh  beeomes  a  predietor  of  how  useful  this 
framework  is  for  deseribing  an  international  program. 

Two  elements  are  shown  to  have  no  value  for  this  framework.  This 
is  beeause  the  information  that  would  be  eolleeted  in  these  elements  is 
already  eolleeted  in  other  elements.  The  International  Exeeutive  Control 
element  eorresponds  to  the  TMO  Organizational  Aspeets  element.  The 
TMO  funding  element  eorresponds  to  the  Cost  Share  Work  Share 
element.  Another  element  that  may  be  redundant  is  the  Teehnieal 
Monitoring  Capability  element.  This  element  overlaps  with  the 
RDEC/ Contraetor  Teehnieal  Support  element.  Overall,  it  appears  the 
TMO  framework  has  value  for  deseription  and  study  of  a  range  of 
international  programs,  but  the  greatest  utility  is  for  the  deseription  and 
study  of  tightly  eoupled  international  programs. 

2.  TMO  Conclusions 

This  paper  proposes  a  framework  for  eapturing  and  studying  TMO 
insights  for  international  programs.  Interviews  were  eondueted  with  key 
program  personnel  from  several  programs  to  populate  the  framework 
with  program  data.  Programs  eonsidered  were  HAWK,  ROLAND,  LANCE, 
MEADS,  the  International  Spaee  Station,  and  MLRS  TGW.  These 
programs  had  various  degrees  of  international  partieipation.  Valuable 
insights  were  eaptured  that  ean  be  applied  to  the  strueture  and  eonduet 
of  ongoing  and  future  international  programs. 

From  the  information  eolleeted,  speeifie  eonelusions  ean  be  made 
regarding  international  programs: 

.  TMO  Organizational  Aspeets 

-  The  organization  strueture  and  rules  for  ehange  strongly  impaet 
TMO. 

-  Coupling  within  international  programs  affeets  management 
eomplexity. 
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-  There  may  be  a  relationship  between  the  degree  of  eoupling  of 
international  programs  and  program  sueeess,  but  this  was  not 
verified  with  data. 

.  RDEC/Contraetor  Teehnieal  Support 

-  TMO  Teehnieal  Support  is  erueial  for  international  programs. 

-  Support  is  needed  to  ensure  eontraetor  aeeountability,  to  do 
requirements  analysis,  to  aid  in  teehnology  transfer,  to  make 
direet  teehnieal  eontributions  and  to  represent  the  Users 
interests. 

-  When  eost  share  and  work  share  are  eonsiderations,  they  must 
be  applied  to  Teehnieal  Support 

.  Management  of  Teehnieal  Requirements 

-  Knowing  who  the  eustomer  is,  is  important  (Colleetively  the 
Users  of  the  partieipating  nations). 

-  Requirements  analysis  and  update  is  more  diffieult  for  an 
international  program  and  the  diffieulty  inereases  with  the 
number  of  partieipants. 

-  Early  establishment  a  proeess  for  elarifieation  and  update  of 
requirements  is  important. 

-  Loeal  national  representatives  should  be  empowered  to  approve 
requirements  ehanges  and  speeifieation  ehanges  that  do  not 
affeet  the  major  performanee  requirements  of  the  system. 

-  Stabilizing  of  requirements  before  starting  a  major  international 
development  is  desirable.  If  ehanges  are  neeessary,  they  should 
be  done  prior  to  start  of  a  foeused  development  aetivity. 

•  Management  of  Teehnieal  Risk 

-  Risks  should  be  identified  and  aeknowledged,  but  diplomaey  is 
important 

-  There  is  risk  integrating  systems  developed  outside  the  U.S.  into 
U.S.  Systems  and  this  risk  should  be  managed  (see  ROLAND 
write-up). 

-  For  tightly  eoupled  international  development  programs, 
teehnology  transfer  risks  must  be  aggressively  managed.  Some 
independent  US  aetion  should  be  expeeted  if  full  diselosure  of 
information  is  not  provided. 
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Technical  Monitoring  Capability 

-  Establishing  an  effective  TMO  presence  as  a  legitimate  part  of 
the  Contractor/ IPO /Government  development  effort  will  pay  big 
dividends. 

-  Diplomatic  communication  is  important  when  one  country 
monitors /  reviews  another  countries  contractors 

-  Responsibility  for  oversight  of  a  nations  contractors  can  be 
effectively  accomplished  by  representatives  of  that  nation.  (See 
write-up  for  MLRS  TGW) 

Direct  Technical  Contribution 

-  TMO  direct  technical  contributions  are  crucial  for  program 
success 

-  Areas  for  TMO  direct  technical  contribution  include 
requirements  analysis,  trade  studies,  coordination  of  technology 
transfer,  simulation,  performance  evaluation,  interoperability, 
human  systems  integration,  and  whatever  expertise  people  have 
in  the  IPO  and  in  the  NPOs. 

-  IPO  and  NPO  can  become  too  involved  and  add  schedule  risk 

Control  of  and  Access  to  Technical  Data 

-  Effective  configuration  management  of  internal  program  data  is 
crucial.  National  representatives  within  an  IPO  should  be 
empowered  to  authorize  changes  not  affecting  major 
performance  requirements  of  the  system. 

-  Tightly  coupled  international  programs  that  require  access  to 
tightly  controlled  technical  data  require  special  management 
attention,  especially  from  the  nation  that  is  controlling  the 
information. 

-  Clear  Technology  release  policy  is  crucial. 

-  Consistency  in  the  release  and  control  of  information  from  one 
nation  to  others  is  extremely  important.  Once  data  of  a  certain 
type  has  been  released,  it  is  understandable  why  national 
representatives  are  offended  when  information  of  that  type  is 
withheld  later.  International  incidents  may  be  generated  if  this 
occurs. 

-  False  impressions  of  future  information  release  must  be 
avoided.  The  risk  of  potentially  not  getting  release  should  be 
understood. 
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-  Arrangements  need  to  be  made  for  effieient  transfer  of  elassified 
and  unelassified  program  information,  both  eleetronieally  and 
hardeopy,  to  and  from  the  partieipating  nations. 

•  User  Partieipation 

-  User  partieipation  is  important  for  the  elarifieation  of 
requirements,  human  system  integration  trade  studies  and  test 

-  Partieipating  Nations  have  different  views  on  the  degree  of  User 
partieipation. 

•  Cost  Share  and  Work  Share 

-  It  is  possible  to  manage  overall  work  share  in  a  way  that  allows 
aeeess  to  partieipating  government’s  Labs  and  ageneies  (See 
MLRS  TGW  write-up)  as  well  as  to  support  eontraetors 

-  An  agreement  to  allow  balaneing  of  work  share  in  subsequent 
program  phases  ean  be  very  helpful  and  give  the  IPO  mueh 
needed  flexibility  for  TMO. 

.  Preparation  of  Contraet  Statements  of  Work 

-  Eaeh  partieipating  nation  must  put  an  SOW  for  system 
development  through  its  national  deeision  proeesses,  making 
the  proeess  for  developing  and  approving  SOWs  very  time 
eonsuming. 

-  Having  senior  people  involved  in  SOW  development  with  the 
eapability  to  make  sensible  eompromises  is  extremely  valuable 

-  A  bad  international  SOW  is  not  more  likely  to  gain  approval  as 
it  ages. 

•  National  Interaetion 

-  Patienee  and  diplomaey  are  important 

-  Release  requirements  for  information  eomplieate  National 
Interaetion 

-  Management  attention  is  needed  in  US  involvement  in 
International  programs  to  edueate  partieipants  in  the  US 
aequisition  proeess  about  the  uniqueness  of  international 
programs. 
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.  U.S.  Acquisition  Review  Prior  to  the  Next  Program  Phase. 

-  U.S.  Poliey  for  aequisition  review  has  not  eaught  up  with 
international  programs  and  needs  to  be  updated  following 
serious  debate  about  priorities  and  teehnology  transfer  polieies. 


3.  TMO  Recommendations 

.  For  future  international  programs,  eonsider  minimizing  the 
international  eoupling  of  the  programs  so  that  the  need  for 
international  eoordination  is  minimized,  organizational  frietion  is 
redueed  and  eaeh  partner  is  able  to  understand  the  national  role  in 
the  development  program. 

.  Initiate  a  debate  within  the  U.S.  about  the  degree  to  whieh  the  U.S. 
will  partieipate  in  future  international  programs  that  neeessitate 
release  of  sensitive  U.S.  data. 

.  For  future  international  programs,  ensure  adequate  proeesses  are 
established  prior  to  program  initiation  to  manage  eost  share  and  work 
share  to  enable  aeeess  to  national  laboratories,  support  eontraetors, 
prime  eontraetors  and  subeontraetors. 

.  Know  the  eustomer. 

.  Train  all  partieipants  in  international  programs  how  to  be  diplomatie 
in  eommunieating  to  international  eounterparts. 

.  Antieipate  and  plan  for  U.S.  speeifie  aetivity  in  tightly  eoupled 
international  programs  that  involve  use  of  sensitive  U.S.  data. 

.  For  future  international  programs,  plan  teehnieal  staff  for  both 
international  and  U.S.  speeifie  aetivities  to  address  teehnieal  issues 
that  are  out  of  reaeh  of  the  prime  eontraetor. 

.  For  future  international  programs,  plan  resourees  to  support 
teehnology  transfer  and  to  obtain  approvals  to  release  U.S. 
information  into  the  international  program. 

•  For  future  international  programs,  make  plans  for  eourier  and 

eleetronie  transfer  of  elassified  and  unelassified  program  information 
between  all  parties. 

.  Plan  to  balanee  work  share  aeross  program  phases  to  improve  TMO 
flexibility. 

.  Plan  adequate  time  for  preparation  and  approval  of  international 
SOWS. 


107 


B.  TMO  FRAMEWORK  ELEMENT  ANALYSIS 

1.  TMO  Considerations  Framework  Elements 

a.  TMO  International  Organizational  Aspects 

(1)  Framework  Element  Analysis.  The  International 
Organizational  Aspeets  TMO  Framework  Element  has  high  value.  With 
information  from  this  element  it  was  possible  to  elassify  programs 
aeeording  to  degree  of  international  involvement,  method  of  involvement, 
and  degree  eoupling  of  international  partners.  Deseribing  a  program  as 
“Tightly  Coupled,”  sueh  as  for  the  MEADS  program,  suggests  that 
program  sueeess  is  highly  dependent  upon  sueeessful  eoordination 
between  the  international  partners.  Deseribing  a  program  as  loosely 
eoupled,  sueh  as  for  the  International  spaee  station,  suggests  that  the 
program  ean  be  sueeessful  with  minimal  eoordination  between  national 
partners.  Table  19  lists  the  programs,  suggests  elassifieation  of  the 
programs  and  suggests  a  high  value  for  this  framework  element  as 
applied  to  eaeh  of  the  programs  reviewed. 

(2)  TMO  Lessons  Learned.  The  programs  reviewed 
had  varied  international  organizational  aspeets.  From  the  information 
gathered  in  ehapter  IV,  it  ean  be  surmised  that  the  degree  of 
international  involvement  does  not  impaet  program  exeeution  nearly  as 
mueh  as  the  method  of  involvement  and  the  degree  of  eoupling  between 
international  partners  in  the  management  of  the  program.  It  is  apparent 
that  tightly  eoupled  international  programs  are  more  organizationally 
eomplex  than  loosely  eoupled  international  programs.  The  organization 
strueture  and  rules  for  ehange  strongly  impaet  TMO. 
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Table  19:  TMO  Internatinal  Organizational  Considerations 


TMO  Framework  Element: 

TMO  International  Organizational  Considerations 

PROGRAM 

PROGRAM  CLASSIFICATION 

VALUE 

COMMENT 

HAWK 

US  Developed  (Almost  No 
coupling)  With  Foreign  Sales  and 
Production 

HIGH 

This  element  can  be 
used  to  characterize 
the  nature  of  the 
program  being 
considered.  The 
programs. 

Information 
collected  in  this 
framework  element 
was  distilled  to 
create  the  Program 
Classification 

Column  in  this 
table. 

ROLAND 

Foreign  Developed  (Almost  No 
Coupling)  with  US  Production 

HIGH 

LANCE 

US  Developed  (No  Coupling)  with 
Foreign  Sales 

HIGH 

MEADS 

Tightly  Coupled  International 
Development  with  Shared 
Leadership 

HIGH 

International 

Space 

Station 

Loosely  Coupled  International 
Development 

HIGH 

MLRS  TGW 

Tightly  Coupled  International 
Development  with  US  Leadership 

HIGH 

b.  RDEC/Contractor  Technical  Support 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  mixed  value  for  evaluating  international 
programs.  The  value  depends  on  the  organizational  aspeets  of  the 
program.  Table  20  summarizes  the  value  of  this  element  for  an 
International  TMO  Framework  eonsidering  the  six  programs  reviewed. 
For  programs  with  tight  eoupling  between  international  partners,  this  is 
a  erueial  area  for  management  attention.  For  other  programs,  the 
teehnieal  value  remains  high  for  obtaining  eompetent  support,  however, 
for  these  programs  there  are  few  international  diffieulties  related  to  the 
support. 
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Table  20:  RD EC/ Contractor  Technical  Support 


TMO  Framework  Element: 

RDEC/Contractor  Technical  Support 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

Minimal  international  considerations.  The  support  provided 
was  crucial,  especially  for  system  improvements  and  failure 
analysis.  After  international  production  began,  this  technical 
support  was  critical  for  resolving  international  issues. 

ROLAND 

LOW 

Minimal  international  considerations,  but  critical  for 
program,  especially  in  overcoming  MTBF  and  calibration 
problems. 

LANCE 

LOW 

Minimal  international  considerations,  but  critical  for 
program,  especially  for  technology  transfer  from  Government 
Labs  to  industry 

MEADS 

HIGH 

Work  Share  complicates  arranging  for  RDEC  or  contractor 
technical  support.  Work  share  must  be  balanced  between 
nations  overall,  but  no  mechanism  is  established  for 
managing  work  share  with  RDEC,  although  arrangements 
have  been  made  to  manage  work  share  for  a  support 
contractor.  Technology  transfer  issues  make  it  unclear  what 
kind  of  support  RDEC  and  support  contractors  can  provide  if 
arrangements  are  made.  For  US  specific  support,  RDEC  and 
support  contractors  are  involved  through  the  US  NPO,  but  for 
this,  work  share  is  not  a  consideration. 

Inter¬ 

national 

Space 

Station 

LOW 

Each  country  is  responsible  for  the  portion  of  the  ISS  that  it 
has  agreed  to  build.  Boeing  remains  responsible  for 
coordinating  systems  issues,  and  is  able  to  access  the  NASA 
labs  for  technology  and  test  assistance  as  needed. 

MLRS  TGW 

HIGH 

RDEC  was  involved  in  MLRS  TGW  both  for  US  Specific 
support  and  for  international  support.  Work  share  was  a 
consideration,  but  a  mechanism  was  in  place  in  the  MLRS 
project  office  to  track  work  share  allocation.  Technology 
transfer  issues  were  addressed  effectively,  although  it  was  not 
always  easy. 

(2)  The  TMO  Lessons  Learned  from  the  programs 
reviewed  for  the  RDEC  (or  lab,  in  the  ease  of  NASA) /  Contraetor  Teehnieal 
Support  were  not  surprising.  It  was  eonfirmed  that  TMO  teehnieal 
support  is  erueial  for  development  of  eomplex  systems.  It  is  neeessary  to 
ensure  eontraetor  aeeountability,  to  do  requirements  analysis,  to  aid  in 
teehnology  transfer,  in  some  eases  to  find  solutions  to  problems  that  the 
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prime  contractor  is  not  well  situated  to  solve,  and  to  represent  the  user. 
The  HAWK,  Roland,  LANCE  and  ISS  programs  did  not  encounter 
significant  problems  related  to  the  international  aspects  of  technical 
support.  Also,  the  MLRS  TGW  program  successfully  engaged  the  RDEC 
and  technical  support  community  for  both  US  specific  and  shared 
international  activity.  MEADS  has  been  able  to  engage  the  support 
contractor  community  and  RDEC  for  US  specific  activity  but  remains 
challenged  to  engaged  RDEC  for  direct  support  of  the  international 
program. 


c.  Management  of  Technical  Requirements 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  mixed  value  for  evaluating  international 
programs.  The  value  depends  on  the  organizational  aspects  of  the 
program.  Table  2 1  summarizes  the  value  of  this  element  for  an 
International  TMO  Framework  considering  the  six  programs  reviewed. 
For  programs  with  tight  coupling  between  international  partners, 
management  of  technical  requirements  is  a  crucial  area  for  management 
attention.  For  other  programs,  it  remains  important  to  manage 
requirements  effectively,  however,  for  these  programs  there  are  few 
international  issues  related  to  requirements  management. 

(2)  The  TMO  Lessons  Learned  from  the  programs 
reviewed  for  TMO  requirements  management  for  international  programs 
are  similar  to  what  is  known  about  major  development  programs  in 
general.  First,  the  customer  must  be  identified  and  his/her  needs  must 
be  addressed.  For  US  programs,  the  customer  is  the  User  who 
represents  the  soldiers  who  will  be  responsible  for  the  system.  For 
international  programs,  the  customer  is  collectively  the  Users  of  the 
participating  nations. 
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Table  2 1 :  Management  of  Technical  Requirements 


TMO  Framework  Element:  Management  of  Technical  Requirements 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

Minimal  international  considerations.  However,  stable 
requirements  were  especially  important  once  involvement 
began  with  the  international  community. 

ROLAND 

ZERO 

No  international  considerations.  U.S.  requirements  were 
the  only  consideration  once  the  data  package  was  obtained 
from  the  Europeans. 

LANCE 

ZERO 

LANCE  was  a  US  System  sold  to  Europeans.  No 
international  participation  with  requirements. 

MEADS 

HIGH 

MEADS  is  a  tightly  coupled  international  activity. 

Obtaining  initial  agreement  on  requirements  was  very  time 
consuming  requiring  agreement  from  all  parties.  As  U.S. 
user  requirements  have  matured,  needed  clarifications  to 
the  international  requirements  have  not  kept  pace,  mostly 
as  a  result  of  needing  consensus  from  partner  nations.  US 
user  satisfaction  with  the  MEADS  system  may  hinge  on 
effective  international  TMO  of  requirements. 

Inter¬ 

national 

Spaee 

Station 

MEDIUM 

Each  country  is  responsible  for  the  portion  of  the  ISS  that  it 
has  agreed  to  build  and  is  responsible  to  maintain 
requirements  for  the  system  elements  it  is  developing. 

Boeing  is  responsible  for  maintaining  configuration  control 
over  key  interfaces,  such  as  the  docking  interface  and  the 
shuttle  payload  bay  interface.  Boeing  remains  responsible 
for  coordinating  systems  issues,  and  is  able  to  access  the 
NASA  labs  for  technology  and  test  assistance  as  needed. 

MLRS  TGW 

HIGH 

Establishing  a  set  initial  requirements  was  difficult.  This 
applied  particularly  to  the  required  target  set.  This  led  to 
difficulties  selecting  technology  from  that  available  from  the 
partners.  Except  for  the  top  level  requirements, 
management  of  requirements  changes,  though  difficult,  was 
handled  locally  by  empowered  national  technical 
representatives. 

The  requirements  analysis  and  update  proeess,  time 
eonsuming  and  eumbersome  for  US  programs,  is  more  diffieult  for 
international  programs.  For  international  programs,  the  requirements 
and  ehanges  need  to  be  agreed  upon  by  all  parties.  Thus,  a  signifieant 
lesson  learned  is  that  stabilizing  requirements  before  initiating  an 
international  program  is  important.  Also,  loeal  eountry  representatives 
should  be  empowered  to  make  deeisions  for  ehange  of  alloeated 
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requirements  that  do  not  ehange  the  overall  system  requirements.  It 
should  be  understood  by  all  national  parties  that  some  requirements  will 
have  to  be  ehanged  or  elarified.  It  is  diffieult  to  get  all  the  requirements 
100  pereent  eorreet  at  the  start  of  a  program.  Nevertheless,  requirements 
must  stabilize  before  major  requirements  alloeation  and  design  aetivity 
begins,  or  else  uneontrolled  eost  will  result. 

d.  Management  of  Technical  Risk 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  value  for  evaluating  most  international 
programs  reviewed.  For  LANCE  there  was  no  framework  value  beeause, 
the  program  was  managed  solely  by  the  US.  Table  22  summarizes  the 
value  of  this  element  for  an  International  TMO  Framework  for  the  six 
programs  reviewed. 

For  programs  with  tight  eoupling  between 
international  partners,  international  eonsiderations  for  management  of 
teehnieal  risk  are  erueial  for  management  attention.  For  other  programs, 
there  is  value  beeause  of  shared  risk  and  the  need  to  eoordinate  to 
address  this  risk. 


(2)  The  lessons  learned  for  Management  of  Teehnieal 
Risk  for  the  programs  reviewed  are  valuable.  Partieipants  in  an 
international  aequisition  program  should  be  prepared  to  aggressively 
address  teehnieal  risk  while  remaining  diplomatie  and  eareful  about 
assigning  blame  when  issues  arise.  There  is  risk  of  integrating  systems 
into  the  US  for  systems  that  were  developed  and  tested  elsewhere.  For 
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Table  22:  Management  of  Technical  Risk 


TMO  Framework  Element:  Management  of  Technical  Risk 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

MEDIUM 

International  considerations  after  international 
production.  Program  risk  continues  after  production,  and 
when  things  go  wrong,  such  as  missiles  blowing  up 
during  lot  testing,  finger  pointing  may  begin,  high  level 
national  representatives  may  get  involved  and  the  problem 
resolution  made  more  difficult. 

ROLAND 

MEDIUM 

International  considerations  involved  understanding  the 
European  developed  processes  and  designs.  Further, 
Roland  was  assumed  to  be  a  mature  system.  Some 
redesign  was  required  to  stabilize  calibration  of  the  radar. 

LANCE 

ZERO 

LANCE  was  a  US  System  sold  to  Europeans.  No 
international  participation  with  risk. 

MEADS 

HIGH 

MEADS  is  a  tightly  coupled  international  activity. 

MEADS  pushes  the  state  of  the  art  for  Radar  and  missile 
technology,  and  involves  transfer  of  sensitive  U.S. 
technology.  There  is  risk  for  successful  integration  of 
advanced  technology  and  there  is  risk  related  to 
technology  transfer.  The  system  has  not  yet  been 
developed,  and  much  effort  will  be  required  by  all  to 
successfully  address  the  risk  on  this  program. 

Inter¬ 

national 

Space 

Station 

MEDIUM 

Each  country  is  responsible  for  the  portion  of  the  ISS  that 
it  has  agreed  to  build  and  is  responsible  to  maintain 
manage  the  risk  for  the  system  elements  it  is  developing. 
The  international  considerations  for  risk  involve 
interfaces.  Boeing’s  unique  approach  providing  the 
physical  docking  interfaces  f  between  space  station 
modules  minimizes  some  of  this  concern.  Nevertheless, 
close  international  cooperation  is  needed  when  issues 
arise  to  ensure  safety. 

MLRS  TGW 

HIGH 

The  varied  nature  of  potential  targets  for  TGW  led  to 
consideration  of  a  variety  of  technologies,  which  were 
available  in  the  different  partner  nations.  While  technical 
considerations  were  the  major  risk  driver,  work  share 
issues  had  influence,  complicating  the  technical  solutions 
and  increasing  risk.  Technology  transfer  issues  were  a 
factor,  but  because  significant  technology  was  coming 
from  Europe,  the  risk  of  US  technology  transfer  was 
minimized. 

this  situation,  objective  testing  should  be  done.  For  tightly  coupled 
international  development  activities,  it  is  important  to  address 
technology  transfer  risk.  When  access  is  limited,  consideration  should 
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be  given  to  independent  U.S.  aetion.  While  not  the  preferred  approaeh 
from  the  point  of  the  international  partners,  this  may  be  the  only  viable 
option. 


e.  Technical  Monitoring  Capability 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  value  for  evaluating  international  programs,  but 
it’s  value  is  redueed  beeause  of  the  overlap  between  this  element  and  the 
RDEC/ Contraet  Support  framework  element.  Table  23  summarizes  the 
value  of  this  element  for  an  International  TMO  Framework  for  the  six 
programs  reviewed. 

(2)  TMO  Lessons  Learned  for  teehnieal  monitoring  for 
the  six  programs  reviewed  are  limited  beeause  some  of  the  pertinent  data 
was  eolleeted  under  the  RDEC /  Contraetor  Teehnieal  Support  framework 
element.  However,  there  was  a  re-emphasis  of  the  importanee  of 
eommunieating  diplomatieally  when  U.S.  monitoring  of  partner 
development  is  eondueted.  NASA’s  experienee  was  that  the  NASA  role  of 
being  watehdog  for  safety  and  reliability  was  aeeepted  and  NASA 
personnel  and  support  eontraetors  are  aeeepted  as  part  of  the 
development  teams.  The  MLRS  TOW  program  distributed  responsibilities 
for  oversight  aeeording  to  whieh  nation  was  doing  the  work,  whieh  was 
effeetive. 
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Table  23:  Technical  Monitoring  Capability 


TMO  Framework  Element:  Technical  Monitoring  Capability 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

Some  international  consideration  for  technical  monitoring. 
When  production  problems  occurred  in  US,  European 
production  questioned  the  US  provided  data  package  and 

US  consultants  went  overseas  to  evaluate.  Engineering 
evaluations  became  political  and  had  a  major  influence  on 
HAWK  program  international  efforts. 

ROLAND 

ZERO 

US  Program  was  only  concerned  with  US  production  and 
fielding 

LANCE 

ZERO 

100  %  US  managed  effort.  TMO  Technical  Monitoring  did 
not  have  international  considerations. 

MEADS 

MEDIUM 

TMO  Technical  monitoring  is  affected  by  cost  share  and 
work  share  along  with  technology  transfer.  There  is  an 
overlap  between  this  TMO  Framework  element  and  the 
RDEC/ Contractor  Support  TMO  Framework  Element, 
however,  and  so  the  value  of  this  framework  element  is 
reduced. 

Inter¬ 

national 

Space 

Station 

MEDIUM 

TMO  Technical  Monitoring  did  involve  international 
considerations  for  ISS,  particularly  because  safety  of 
operations  is  paramount  for  NASA.  Overlap  of  this  element 
with  RDEC/ Support  Contractor  TMO  Framework  Element 
reduces  value.  Additionally,  as  the  MEADS  program 
progresses  past  the  planning  activities  and  into 
development,  this  framework  element  may  increase  in 
value. 

MLRS  TGW 

MEDIUM 

This  framework  element  was  of  value  because  it  brought 
focus  to  the  distribution  of  responsibilities  for  TMO 

Technical  monitoring  among  the  participating  nations. 
However,  the  value  was  reduced  because  of  the  overlap  with 
another  framework  element. 

/.  Direct  Technical  Contribution 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  value  for  deseribing  international  programs. 
The  value  is  related  to  the  degree  of  eoupling  between  partner-nation 
management  proeesses.  Additionally,  Table  24  summarizes  the  value  of 
this  element  for  an  International  TMO  Framework  for  the  six  programs 
reviewed. 
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Table  24:  Direct  Technical  Contribution 


TMO  Framework  Element:  Direct  Technical  Contribution 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

Little  of  the  HAWK  TMO  Direct  Technical  Contribution 
was  international  in  nature  or  constrained  by  the 
international  nature  of  the  program. 

ROLAND 

LOW 

Little  of  the  ROLAND  TMO  Direct  Technical  Contribution 
was  international  in  nature  or  constrained  by  the  nature 
of  the  program. 

LANCE 

ZERO 

TMO  Direct  Technical  Contribution  did  not  have 
international  considerations. 

MEADS 

HIGH 

The  value  for  MEADS  is  evident  for  requirements  analysis 
for  both  US  specific  effort  and  international  effort. 
Additionally,  effort  to  develop  a  comprehensive  yet  concise 
SOW  for  the  future  D8&D  development  phase  will  be 
important.  Important  contributions  related  to  obtaining 
approvals  for  technology  transfer  are  anticipated.  In 
addition,  contributions  made  by  RDEC/ Support 
Contractors  will  be  important,  but  this  is  described  in 
another  area,  and  so  there  is  overlap  between  these 
framework  elements. 

Inter¬ 

national 

Space 

Station 

MEDIUM 

The  technical  contributions  of  NASA  tended  to  be  in  the 
technology  area  where  the  labs  were  involved  and  in 
procedures  intended  to  ensure  safety  and  reliability. 
However,  this  framework  element  overlapped  with  the 
RDEC/ Support  contractor  element,  minimizing  the  value 
of  this  element  relative  to  the  ISS  and  the  TMO 
framework. 

MLRS  TGW 

HIGH 

Personnel  from  each  nation  were  competent  with  opinions 
about  the  best  technical  approaches.  Having  a  high 
degree  of  talent  in  the  TMO  activity  was  both  a  good  and 
bad.  The  good  part  was  that  difficult  technical  issues 
received  a  lot  of  TMO  attention,  helping  to  ensure  that 
problems  were  understood  and  thoroughly  addressed. 

The  bad  part  about  this  was  that  sometimes  progress  was 
slowed  by  the  variety  of  opinions  that  had  to  be  addressed 
fairly.  Addressing  problems  that  turned  out  not  to  be 
problems  took  time  and  energy  away  from  solving  real 
problems. 
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(2)  TMO  Lessons  Learned  for  direet  teehnieal 
eontribution  for  the  six  programs  reviewed  are  that  there  is  high  value  in 
teehnieal  eontributions  from  TMO  personnel  for  both  U.S.  and 
international  development  programs.  For  international  development 
programs,  work  share  and  teehnology  transfer  issues  eomplieate 
availability  of  personnel  and  information,  TMO  direet  teehnieal 
eontributions  are  erueial  for  program  sueeess.  Requirements  analysis 
and  SOW  preparation  are  valuable  areas  for  direet  teehnieal  eontribution 
for  international  programs.  For  tightly  eoupled  international  programs, 
work  share  and  teehnology  transfer  eoneerns  will  eomplieate  this  effort. 
Additionally,  TMO  interfaees  with  other  programs  and  ageneies  ean 
provide  valuable  direet  teehnieal  eontribution  in  the  identifying  of  and 
resolving  of  issues  that  are  driven  by  interfaee  to  other  programs. 

g.  Control  of  and  Access  to  Technical  Data 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  mixed  value  for  deseribing  international 
programs.  The  value  relates  to  the  eoupling  between  partner-nation 
management  proeesses.  Table  25  summarizes  the  value  of  this  element 
for  an  International  TMO  Framework  for  the  six  programs  reviewed. 

(2)  TMO  Lessons  Learned.  Control  of  and  aeeess  to 
teehnieal  data  for  international  programs  with  tight  eoupling  is  eritieal. 
The  more  information  that  is  exehanged  for  the  exeeution  of  a  program, 
the  more  important  effeetive  eonfiguration  eontrol  is.  Also,  if  any  of  the 
partieipating  nations  have  teehnology  release  restrietions,  it  is  important 
to  have  elear  teehnology  release  poliey. 

A  negative  lesson  learned  during  the  interview  proeess 
for  this  researeh  paper,  but  not  attributed  to  any  one  program  is  that 
eonsisteney  is  important.  Serious  problems  result  if  information  is 
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Table  25:  Control  of  and  Access  to  Technical  Data 


TMO  Framework  Element: 

Control  of  and  Access  to  Technical  Data 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

There  was  little  application  of  this  international  TMO 
framework  element  for  HAWK  development  that  was 
revealed  by  the  interview.  Export  control  decisions  had  to 
be  made,  but  they  were  for  the  system  and  specific 
information  needed  to  field  and  operate  the  system. 

ROLAND 

ZERO 

There  was  no  application  of  this  international  TMO 
framework  element  for  Roland. 

LANCE 

ZERO 

There  was  no  application  of  this  international  TMO 
framework  element  for  LANCE  that  was  uncovered  by  the 
interview.  However,  the  issues  surrounding  export 
control  would  be  worth  investigating. 

MEADS 

HIGH 

Configuration  Control  is  expected  to  be  more  difficult  due 
to  the  increased  number  of  stakeholders  associated  with 
the  system  requirements.  Procedures  will  need  to  be 
worked  out  to  address  this.  International  aspects  of 
technology  transfer  have  proven  tedious,  with  no 
guarantees  up  front  about  specifically  what  will  or  will  not 
be  released. 

Inter¬ 

national 

Space 

Station 

LOW 

The  control  of  specifications  and  interfaces  for  the  ISS  is 
critical,  however,  the  main  common  concern  is  for  the 
interfaces,  such  as  the  docking  interfaces  and  the  Shuttle 
payload  bay  interface  for  transport  of  ISS  components.  As 
to  access  to  technical  information,  it  is  not  an  issue. 

NASA  has  a  policy  of  openly  sharing  information  with  all 
parties  that  have  a  legitimate  interest. 

MLRS  TGW 

HIGH 

Establishing  access  to  US  information  was  challenging  for 
MLRS.  Secure  communications  links  were  established  by 
providing  encryption  and  communications  equipment  to 
partner  nations.  The  flow  of  information  between  national 
program  offices  was  difficult  and  required  special 
accommodation. 

released  and  then  the  release  poliey  is  further  restrieted.  The  lesson: 
Make  sure  release  polieies  are  well  established  before  providing  data  to 
international  partners.  International  ineidents  may  oeeur  if  release 
poliey  is  made  more  restrietive  as  a  program  progresses.  People  get 
upset.  Countries  feel  insulted.  Issues  of  this  nature  may  rise  to  the 
highest  levels  of  Government. 
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Special  arrangements  should  be  made  for  transmittal 
of  technical  information  between  countries.  U.S.  Policies  for  technology 
transfer  do  not  seem  to  be  consistent  with  international  agreements  for 
cooperative  development.  There  are  advocates  and  detractors  for  more 
openness.  In  a  fully  cooperative  development,  one  would  think  that  all 
national  parties  would  bring  all  of  their  technical  knowledge  to  the 
program.  However,  the  U.S.  has  not  yet  made  that  level  of  commitment 
to  international  programs.  Concern  for  security  of  information  and  a  fear 
that  vulnerabilities  of  other  systems  may  be  revealed,  lead  the  U.S.  to 
carefully  scrutinize  all  requests  for  information. 

h.  User  Participation 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  mixed  value  for  describing  international 
programs.  The  value  is  related  to  the  degree  of  coupling  between 
partner-nation  management  processes.  Table  26  summarizes  the  value 
of  this  element  for  an  International  TMO  Framework  for  the  six  programs 
reviewed. 


(2)  TMO  Lessons  Learned.  User  participation  is 
important  for  any  major  development  effort,  particularly  for  establishing 
overall  requirements,  human  system  interface  requirements  and  other 
user  related  requirements  such  as  training  and  maintenance.  In 
international  programs,  means  for  coordinating  clarifications  and 
updates  of  requirements  is  critical.  Program  management  understanding 
of  how  the  various  Users  plan  to  fight  the  system  is  critical. 
Understanding  of  how  training  for  the  system  will  be  done  is  critical. 
Establishing  an  understanding  of  how  the  system  will  be  tested  in  a  user 
environment,  usually  called  Initial  Operational  Test  and  Evaluation 
(lOT&E)  in  the  U.S.  is  critical. 
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Table  26:  User  Participation 


TMO  Framework  Element:  User  Participation 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

There  was  no  international  User  consideration  for  HAWK 
development. 

ROLAND 

LOW 

There  was  no  international  User  consideration  for  Roland 
development,  however,  the  US  user  was  vitally  concerned 
with  ensuring  that  ROLAND  met  its  advertised  performance. 

LANCE 

LOW 

There  was  no  international  User  consideration  for  LANCE 
development. 

MEADS 

HIGH 

User  participation  is  typically  less  for  European  system 
development  than  for  US  development.  Understanding  this 
is  important  to  participants  in  international  programs.  In 
the  case  of  MEADS  US  participants,  there  is  an  expectation 
of  early  and  continuous  User  involvement.  However,  the 
same  is  not  true  for  other  participants.  The  balance 
achieved  for  MEADS  will  be  instructive  and  may  be  of  use  to 
other  programs. 

Inter¬ 

national 

Space 

Station 

Low 

This  framework  element  may  not  apply  to  NASA  because  of 
the  way  NASA  is  organized.  NASA  both  writes  the 
requirements  for  its  systems  and  then  develops  the  systems. 
Astronauts  can  be  looked  at  as  users  of  the  ISS,  however, 
they  did  not  get  involved  in  writing  a  requirements  document 
for  the  ISS.  Astronauts  do  get  involved  in  developing  some  of 
the  requirements  related  to  Human  System  Integration. 

MLRS  TGW 

HIGH 

International  User  participation  was  critical  for  establishing 
the  basic  requirements  of  TGW.  This  was  recognized  by 
including  on  the  TGW  Management  Executive  Committee 
both  the  national  PM  for  MLRS  and  the  national  User 
representative. 

i.  Cost  Share  and  Work  Share 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  mixed  value  for  deseribing  international 
programs.  Its  value  relates  to  the  international  eoupling.  Table  27 
summarizes  the  value  of  this  element  for  an  International  TMO 
Framework  for  the  six  programs  reviewed. 
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Table  27:  Cost  Share  and  Work  Share 


TMO  Framework  Element:  Cost  Share  and  Work  Share 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

There  was  no  international  Cost  Share  and  Work  Share 
consideration  for  HAWK  development,  although 
arrangements  were  made  for  co-production  of  HAWK  in 
Europe  and  Japan. 

ROLAND 

LOW 

There  was  no  international  Cost  Share  and  Work  Share 
consideration  for  Roland  development,  however,  the  US 
bought  and  produced  ROLAND  partially  to  offset  European 
purchases  of  US  systems  such  as  HAWK 

LANCE 

LOW 

There  was  no  international  User  consideration  for  LANCE 
development. 

MEADS 

HIGH 

Cost  share  and  work  share  arrangements  for  MEADS  are 
critical  to  continued  participation  by  all  parties. 

Establishing  a  method  for  managing  overall  work  share  to 
allow  participation  of  national  laboratories  such  as  RDEC 
will  be  important  if  significant  program  involvement  of  these 
institutions  is  to  occur. 

Inter¬ 

national 

Space 

Station 

Low 

There  was  and  is  no  consideration  for  cost  share  or  work 
share  related  to  the  ISS.  Participants  pay  for  whatever 
hardware  they  contribute  and  they  gain  prestige  from  their 
participation. 

MLRS 

TGW 

HIGH 

Cost  share  and  work  share  were  carefully  managed  for  MLRS 
TGW.  The  program  manager,  who  was  a  US  Army  Colonel, 
was  responsible  for  balancing  the  overall  work  share. 

Unique  arrangements  were  made  to  minimize  foreign 
currency  conversions. 

(2)  TMO  Lessons  Learned.  Cost  share  and  work  share 
are  not  applieable  to  all  international  development  efforts.  If  Cost  share 
and  work  share  are  required  in  an  international  effort,  then  they  must  be 
balaneed  aeeording  to  international  agreement.  The  pereentages  are  very 
important  to  the  personnel  from  partieipating  nations.  Their  authority  to 
partieipate  in  the  program  is  tied  not  only  to  overall  eost,  but  also  to  eost 
share  and  work  share. 

It  is  important  to  establish  meehanisms  for  managing 
eost  share  and  work  share  early  in  the  program.  Having  a  proeess 


122 


managed  directly  by  the  International  Program  Office  will  enable  access 
to  national  laboratories  as  well  as  to  support  contractors. 

Ideally,  an  understanding  should  be  reached  that  work 
share  can  be  balanced  over  several  program  phases.  For  instance,  if 
work  share  gets  out  of  balance  during  development,  then  the  possibility 
should  exist  to  bring  work  share  into  balance  during  production.  One 
way  of  doing  this  is  to  allocate  proceeds  from  external  sales  to  make  up 
for  shortfalls  in  work  share.  Countries  are  loath  to  pay  other  countries 
from  their  treasuries  to  make  up  for  differences  in  work  share. 

j.  Preparation  of  Contract  Statements  of  Work  (SOW) 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  value  for  the  review  of  tightly  coupled 
international  programs.  Table  28  summarizes  the  value  of  this  element 
for  an  International  TMO  Framework  for  the  six  programs  reviewed. 

(2)  TMO  Lessons  Learned.  The  primary  lesson  learned 
about  preparation  of  contract  SOWs  for  international  development 
programs  is  that  considerable  time  is  required  to  obtain  agreement  of 
content  by  the  participating  nations.  Each  nation  must  go  through  an 
independent  staffing  process.  This  is  time  consuming.  TMO  is  involved 
with  development  of  the  SOWs  because  SOWs  for  a  major  system 
development  primarily  address  technical  work  to  be  performed. 

The  development  of  a  SOW  will  typically  be  led  by  a 
senior  technical  person  or  persons.  Having  people  in  the  process  that 
are  personable  and  able  to  make  useful  compromises  with  their 
international  counterparts  is  extremely  important.  Also,  the  earlier 
issues  are  addressed,  the  better.  A  bad  SOW  is  not  more  likely  to  gain 
approval  as  it  gets  older. 
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Table  28:  Preparation  of  Contract  SOWs 


TMO  Framework  Element: 

Preparation  of  Contract  Statements  of  Work  (SOWs) 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

ZERO 

There  was  no  international  coordination  for  preparation  of 
SOWs 

ROLAND 

ZERO 

There  was  no  international  coordination  for  preparation  of 
SOWs 

LANCE 

ZERO 

There  was  no  international  coordination  for  preparation  of 
SOWs 

MEADS 

HIGH 

National  participant  in  MEADS,  represented  by  its  National 
Product  Office  has  been  keen  to  ensure  its  interests  are 
represented  in  the  MEADS  contract  SOWs. 

Inter¬ 

national 

Space 

Station 

ZERO 

There  was  no  international  coordination  for  preparation  of 
SOWs 

MLRS  TGW 

HIGH 

The  SOW  requirements  had  to  go  through  each  nation’s 
decision  processes  and  obtaining  agreement  was  time 
consuming  and  laborious. 

2.  Program  Feedback  And  Inputs  Affecting  TMO 
a.  International  Executive  Control 

(1)  Framework  Element  Analysis.  This  element  adds 
little  value  to  the  International  TMO  Framework  beeause  the  information 
that  might  be  eolleeted  under  this  element  has  already  been  eolleeted 
under  the  element  “TMO  Organizational  Aspeets.” 

(2)  TMO  Lessons  Learned.  No  additional  lessons 
learned  from  those  eaptured  by  the  International  Organizational  Aspeets 
Framework  Element. 
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b.  TMO  Funding 

(1)  Framework  Element  Analysis.  This  element  adds 
little  value  to  the  International  TMO  Framework  beeause  the  information 
that  might  be  eolleeted  under  this  element  has  already  been  eolleeted 
under  the  element  “Cost  Share  and  Work  Share.” 

(2)  TMO  Lessons  Learned.  No  additional  lessons 
learned  from  those  eaptured  by  the  Cost  Share,  Work  Share  TMO 
Framework  Element. 

c.  National  Interaction 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  limited  value  for  the  review  of  loosely  eoupled 
and  high  value  for  tightly  eoupled  international  programs.  Error! 
Reference  source  not  found,  summarizes  the  value  of  this  element  for 
an  International  TMO  Framework  for  the  six  programs  reviewed. 

(2)  TMO  Lessons  Learned.  Regarding  national 
interaetion,  not  all  international  programs  with  international  aspeets 
have  a  eombined  international  program  offiee  per  se,  however,  by 
definition  there  is  some  national  interaetion  in  all  international 
programs.  Patienee  and  diplomaey  are  important.  European  nations 
partieipate  in  more  eooperative  development  efforts  than  does  the  U.S., 
and  are  more  aeeustomed  to  the  international  environment.  The  U.S. 
aequisition  personnel  are  learning,  but  are  inexperieneed  with 
international  programs.  Teehnology  transfer  issues  slow  eommunieation 
between  the  U.S.  eommunity  and  international  programs,  and  a  priority 
is  plaeed  on  proteeting  information  over  making  it  available  to  the 
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Table  29:  National  Interaction 


TMO  Framework  Element:  National  Interaction 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

MEDIUM 

National  Interaction  limited  mostly  to  coordination  for 
purchase  of  complete  HAWK  missile  systems,  the  Tech 

Data  Package  or  individual  system  upgrades.  However, 

US  consultants  reviewed  European  Operations  because  of 
missile  failures  blamed  on  U.S.  Technical  data  package. 

ROLAND 

LOW 

The  burden  of  international  coordination  fell  on  the  US 
contractor.  There  was  a  US /European  Roland  Liaison 
office,  however  this  did  not  affect  TMO. 

LANCE 

ZERO 

There  was  no  unique  national  interaction. 

MEADS 

HIGH 

Formal  national  interaction  is  guided  by  the  MEADS 

MOU,  and  this  interaction  between  national  participants 
and  the  MEADS  program  is  through  the  Steering 
Committee.  US  personnel  in  the  IPO  are  sometimes 
considered  foreign  nationals  and  sometimes  US 
Government  employees. 

Inter¬ 

national 

Space 

Station 

LOW 

There  was  little  national  interaction  for  the  related  to 

TMO.  As  described  in  other  framework  elements,  Boeing 
maintains  the  critical  interfaces  and  does  the  system 
engineering  work. 

MLRS  TGW 

HIGH 

Valuable  information  was  obtained  relating  to  the 
knowledge  of  personnel  in  the  US  acquisition  process  to 
accommodate  international  programs.  The  US  acquisition 
structure  was  not  prepared  to  address  international 
programs,  and  a  lot  of  energy  was  required  to  educate 
participants  in  the  US  acquisition  process  about 
international  programs 

international  program.  The  international  program  offiee  may  be 
eonsidered  a  foreign  entity,  and  all  of  its  personnel,  ineluding  U.S. 
eitizens,  may  be  eonsidered  foreign  agents. 
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d.  U.S.  Acquisition  Review  Prior  to  the  Next  Program 
Phase 

(1)  Framework  Element  Analysis.  This  TMO 
Framework  Element  has  limited  value  for  the  review  of  loosely  eoupled 
and  medium  to  high  value  for  tightly  eoupled  international  programs. 
Table  30  summarizes  the  value  of  this  element  for  an  International  TMO 
Framework  for  the  six  programs  reviewed. 


Table  30:  U.S.  Acquisition  Review 


TMO  Framework  Element: 

U.S.  Acquisition  Review  Prior  to  Next  Program  Phase 

PROGRAM 

VALUE 

INTERNATIONAL  PROGRAM  APPLICATION 

HAWK 

LOW 

HAWK  considered  international  aspects  of  the  program  for 
its  acquisition  strategy.  International  sales  reduced  costs 
because  missile  quantities  were  increased.  However,  the 
process  itself  was  unaffected  by  international  aspects. 

ROLAND 

LOW 

ROLAND  was  purchase  from  the  European  developers  as  a 
technical  data  package,  and  this  influenced  the  acquisition 
process. 

LANCE 

ZERO 

No  International  Influence  on  Acquisition  Process 

MEADS 

HIGH 

The  US  acquisition  process  is  separate  from  the  German 
and  Italian  acquisition  processes  and  the  processes  are  not 
synchronized.  The  US  NPO  is  controlled  by  the  International 
Program  Office,  but  provides  an  interface  to  the  US 
acquisition  process.  US  acquisition  regulations  do  not 
necessarily  apply  to  the  MEADS  acquisition.  This  can  lead 
to  frustration  among  US  employees  assigned  to  the 
international  program  office. 

Inter¬ 

national 

Space 

Station 

ZERO 

The  ISS  does  not  have  acquisition  phases  that  correspond  to 
the  US  Defense  acquisition  phases. 

MLRS 

TOW 

MEDIUM 

The  US  acquisition  process  was  similar  to  that  for  other 

U.S.  systems.  One  exception  was  that  an  effort  was  made  to 
harmonize  documentation  so  that  a  document  developed  to 
satisfy  the  US  acquisition  review  process  would  also  satisfy 
the  European  processes.  Sometimes  non-standard  formats 
were  used  for  documents  to  satisfy  U.S.  acquisition  review. 
Requirements . 
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(2)  TMO  Lessons  Learned.  U.S.  poliey  for  eonduet  of 
international  programs  is  eonfused,  and  this  affeets  the  aequisition 
review  proeess.  U.S.  aequisition  review  prior  to  going  into  sueeeeding 
program  phases  is  flexible  and  tailored  to  meet  the  needs  of  U.S. 
programs  via  DOD  5000  series  doeuments.  These  doeuments 
aeknowledge  international  programs,  but  need  to  be  matured  in  this 
area.  DOD  5000. 2r,  Mandatory  Defense  Aequisition  Proeedures  requires 
the  developing  ageney  (sueh  as  the  Army)  to  ereate  standard  aequisition 
doeumentation.  This  is  in  eonfliet  with  the  need  to  generate  one  set  of 
aequisition  doeuments  to  satisfy  all  nations  that  partieipate.  Continued 
debate  is  needed  about  the  degree  of  U.S.  eommitment  for  international 
programs.  Debate  is  needed  about  whether  seeurity  eoneerns  should 
dominate  poliey  or  whether  effeetive  partnership  should  dominate  poliey. 
Relaxing  seeurity  restrietions  would  allow  direet  interaetion  between 
international  program  offiees  and  the  U.S.  aequisition  proeess,  and 
would  improve  effieieney,  however  the  negative  side  of  this  is  added  risk 
for  the  vulnerability  of  other  U.S.  systems. 
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APPENDIX:  ACRONYMS 


ACAT 

Acquisition  Category 

AMCOM 

Aviation  and  Missile  Command 

AMD 

Air  and  Missile  Defense 

APB 

Aequisition  Program  Baseline 

C4ISP 

Command,  Control,  Communieations,  Computers  and 

Intelligenee  Support  Plan 

CM 

Configuration  Management 

CPI 

Critieal  Program  Information 

DOD 

Department  of  Defense 

DODD 

DOD  Direetive 

DODI 

DOD  Instruetion 

DT 

Developmental  Testing 

DSMC 

Defense  Systems  Management  College 

FOC 

Full  Operational  Capability 

FRP 

Full  Rate  Produetion 

HIS 

Human  System  Integration 

HWIL 

Hardware  In  the  Loop 

IOC 

Initial  Operational  Capability 

IPO 

International  Produet  Offiee 

ITRD 

International  Teehnieal  Requirements  Doeument 

MDA 

Milestone  Deeision  Authority 

MDAP 

Major  Defense  Aequisition  Program 

MEADS 

Medium  Extended  Air  Defense  System 

MICOM 

Missile  Command 

MLRS 

Multiple  Launeh  Roeket  System 

MNS 

Mission  Need  Statement 

MOU 

Memorandum  of  Understanding 

MTBF 

Mean  Time  Between  Failures 
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NAMEADSMA 

NATO  MEADS  Management  Ageney 

NATO 

North  Atlantie  Treaty  Organization 

NPO 

National  Produet  Offiee 

NATO 

North  Atlantie  Treaty  Organization 

NEPA 

National  Environmental  Poliey  Aet  (NEPA) 

ORD 

Operational  Requirements  Doeument 

OT 

Operational  Testing 

PM 

Program  Manager 

PMO 

Program  Management  Offiee 

RDEC 

Researeh,  Development  and  Engineering  Center 

SD&D 

System  Development  and  Demonstration 

SEMP 

System  Engineering  Management  Plan 

SOW 

Statement  Of  Work 

TEMP 

Test  and  Evaluation  Master  Plan 

TOW 

Taetieal  Guided  Warhead 

TMO 

Teehnieal  Management  Oversight 

TPM 

Teehnieal  Performanee  Measure 
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